Sep 06 16:50:34 devstack cinder-volume[76126]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 06 16:50:34 devstack cinder-volume[76126]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 06 16:50:34 devstack cinder-volume[76126]: we strongly recommend against using it for new projects.
Sep 06 16:50:34 devstack cinder-volume[76126]: If you are already using Eventlet, we recommend migrating to a different
Sep 06 16:50:34 devstack cinder-volume[76126]: framework.  For more detail see
Sep 06 16:50:34 devstack cinder-volume[76126]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 06 16:50:34 devstack cinder-volume[76126]:   import eventlet  # noqa
Sep 06 16:50:37 devstack cinder-volume[76126]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 06 16:50:37 devstack cinder-volume[76126]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 06 16:50:37 devstack cinder-volume[76126]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 06 16:50:38 devstack cinder-volume[76126]: INFO dbcounter [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Registered counter for database cinder
Sep 06 16:50:38 devstack cinder-volume[76126]: DEBUG oslo_db.sqlalchemy.engines [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:50:38 devstack cinder-volume[76126]: DEBUG dbcounter [-] [76126] Writer thread running {{(pid=76126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 06 16:50:38 devstack cinder-volume[76126]: INFO cinder.rpc [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 06 16:50:38 devstack cinder-volume[76126]: INFO cinder.rpc [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 06 16:50:38 devstack cinder-volume[76126]: DEBUG oslo_db.sqlalchemy.engines [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:50:38 devstack cinder-volume[76126]: INFO cinder.volume.manager [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Determined volume DB was empty at startup.
Sep 06 16:50:38 devstack cinder-volume[76126]: DEBUG cinder.volume.manager [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76126) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 06 16:50:38 devstack cinder-volume[76126]: INFO cinder.volume.manager [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 06 16:50:38 devstack cinder-volume[76126]: WARNING stevedore.named [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 06 16:50:38 devstack cinder-volume[76126]: WARNING castellan.key_manager [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 16:50:38 devstack cinder-volume[76126]: WARNING cinder.keymgr.conf_key_mgr [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 16:50:38 devstack cinder-volume[76126]: DEBUG cinder.volume.drivers.lvm [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76126) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 06 16:50:38 devstack cinder-volume[76126]: DEBUG oslo_concurrency.processutils [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_concurrency.processutils [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.390s {{(pid=76126) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_db.sqlalchemy.engines [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:50:39 devstack cinder-volume[76126]: INFO cinder.rpc [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 06 16:50:39 devstack cinder-volume[76126]: INFO cinder.rpc [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 06 16:50:39 devstack cinder-volume[76126]: WARNING stevedore.named [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 06 16:50:39 devstack cinder-volume[76126]: WARNING castellan.key_manager [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 16:50:39 devstack cinder-volume[76126]: INFO cinder.volume.manager [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_db.sqlalchemy.engines [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76126) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:50:39 devstack cinder-volume[76126]: INFO oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Starting 1 workers
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Started child 76279 {{(pid=76126) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Full set of CONF: {{(pid=76126) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] ******************************************************************************** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Configuration options gathered from: {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] ================================================================================ {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] allow_availability_zone_fallback = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] allow_compression_on_image_upload = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] allowed_direct_url_schemes     = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] api_rate_limit                 = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] auth_strategy                  = keystone {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] az_cache_duration              = 3600 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76279]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_availability_zone      = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_host                   = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_name                   = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_stats_polling_interval = 60 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backup_api_class               = cinder.backup.api.API {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backup_name_template           = backup-%s {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backup_use_same_host           = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backup_use_temp_snapshot       = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] chap_password                  = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] chap_username                  =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cinder_internal_tenant_project_id = 05d62259658848db865b6f22c4ed7b48 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cinder_internal_tenant_user_id = a1a3aed31f964471a2504646aab63c44 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cloned_volume_same_az          = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cluster                        = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] compression_format             = gzip {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] config_dir                     = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] config_source                  = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] control_exchange               = openstack {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] debug                          = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] default_availability_zone      = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] default_group_type             = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] default_volume_type            = lvmdriver-1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] disk_geometry                  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] driver_client_cert             = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] driver_client_cert_key         = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] driver_data_namespace          = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] driver_ssl_cert_path           = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] driver_ssl_cert_verify         = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] driver_use_ssl                 = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] enable_force_upload            = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] enable_new_services            = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] enable_unsupported_driver      = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] enforce_multipath_for_image_xfer = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] filter_function                = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_api_insecure            = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_api_servers             = ['http://192.168.122.183/image'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_api_ssl_compression     = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_ca_certificates_file    = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_certfile                = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_keyfile                 = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_num_retries             = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance_request_timeout         = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] goodness_function              = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] graceful_shutdown_timeout      = 5 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] group_api_class                = cinder.group.api.API {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] host                           = devstack {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_compress_on_upload       = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_conversion_address_space_limit = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_conversion_cpu_limit     = 60 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_conversion_disable       = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_upload_use_cinder_backend = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_upload_use_internal_tenant = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_volume_cache_enabled     = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_volume_cache_max_count   = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] image_volume_cache_max_size_gb = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] init_host_max_objects_retrieval = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] iscsi_target_flags             =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] iscsi_write_cache              = on {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] iser_helper                    = tgtadm {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] iser_ip_address                = 192.168.122.183 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] iser_port                      = 3260 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] log_color                      = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] log_config_append              = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] log_dir                        = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] log_file                       = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] log_options                    = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] log_rotate_interval            = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] log_rotate_interval_type       = days {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] log_rotation_type              = none {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] max_age                        = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] max_logfile_count              = 30 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] max_logfile_size_mb            = 200 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] max_over_subscription_ratio    = 20.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] message_reap_interval          = 86400 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] message_ttl                    = 2592000 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76279]: INFO cinder.volume.manager [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] migration_create_volume_timeout_secs = 300 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] monkey_patch                   = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] monkey_patch_modules           = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] my_ip                          = 192.168.122.183 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] no_snapshot_gb_quota           = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] num_iser_scan_tries            = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] num_shell_tries                = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] num_volume_device_scan_tries   = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] nvmeof_conn_info_version       = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] nvmet_ns_id                    = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] nvmet_port_id                  = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] osapi_max_limit                = 1000 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] osapi_volume_ext_list          = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] osapi_volume_listen_port       = 8776 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] osapi_volume_use_ssl           = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] osapi_volume_workers           = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] per_volume_size_limit          = -1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] periodic_fuzzy_delay           = 60 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] periodic_interval              = 60 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] public_endpoint                = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] publish_errors                 = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] quota_backup_gigabytes         = 1000 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] quota_backups                  = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] quota_gigabytes                = 1000 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] quota_groups                   = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] quota_snapshots                = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] quota_volumes                  = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] rate_limit_burst               = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] rate_limit_except_level        = CRITICAL {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] rate_limit_interval            = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] reinit_driver_count            = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] replication_device             = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] report_discard_supported       = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] report_interval                = 120 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] reservation_clean_interval     = 86400 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] reservation_expire             = 86400 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] reserved_image_namespaces      = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] reserved_percentage            = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] rpc_response_timeout           = 120 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] run_external_periodic_tasks    = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] scst_target_driver             = iscsi {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] scst_target_iqn_name           = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_down_time              = 720 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] shell_completion               = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] snapshot_name_template         = snapshot-%s {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] snapshot_same_host             = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] split_loggers                  = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] state_path                     = /opt/stack/data/cinder {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] storage_availability_zone      = nova {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] storage_protocol               = iSCSI {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] syslog_log_facility            = LOG_USER {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] target_helper                  = lioadm {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] target_ip_address              = 192.168.122.183 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] target_port                    = 3260 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] target_protocol                = iscsi {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] target_secondary_ip_addresses  = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] trace_flags                    = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] transport_url                  = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] until_refresh                  = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] use_chap_auth                  = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] use_default_quota_class        = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] use_journal                    = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] use_json                       = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] use_multipath_for_image_xfer   = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] use_stderr                     = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] use_syslog                     = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] verify_glance_signatures       = enabled {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_api_class               = cinder.volume.api.API {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_backend_name            = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_clear                   = zero {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_clear_ionice            = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_clear_size              = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_copy_bps_limit          = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_dd_blocksize            = 1M {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_name_template           = volume-%s {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_service_inithost_offload = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volume_usage_audit_period      = month {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] zoning_mode                    = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_concurrency.disable_process_locking = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.auth_section = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.auth_type   = password {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.auth_version = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.cache       = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.certfile    = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.include_service_catalog = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.insecure    = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.interface   = public {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.keyfile     = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_password = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcache_username = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.region_name = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.service_type = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.183/identity {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.backend                  = dogpile.cache.null {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.backend_argument         = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.backend_expiration_time  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.config_prefix            = cache.oslo {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.debug_cache_backend      = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.enable_retry_client      = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.052s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.enable_socket_keepalive  = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.enabled                  = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.expiration_time          = 600 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.hashclient_retry_attempts = 2 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.memcache_dead_retry      = 300 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.memcache_sasl_enabled    = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.password                 = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.proxies                  = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.redis_db                 = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.redis_server             = localhost:6379 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.retry_attempts           = 2 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.retry_delay              = 0.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.socket_keepalive_count   = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.socket_keepalive_idle    = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.socket_keepalive_interval = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.socket_timeout           = 1.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.tls_allowed_ciphers      = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.tls_cafile               = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.tls_certfile             = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.tls_enabled              = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.tls_keyfile              = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cache.username                 = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] coordination.backend_url       = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.asyncio_connection    = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.asyncio_slave_connection = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.backend               = sqlalchemy {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.connection            = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.connection_debug      = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.connection_parameters =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.connection_recycle_time = 3600 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.connection_trace      = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.db_inc_retry_interval = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.db_max_retries        = 20 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.db_max_retry_interval = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.db_retry_interval     = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.max_overflow          = 50 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.max_pool_size         = 5 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.max_retries           = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.mysql_wsrep_sync_wait = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.pool_timeout          = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.retry_interval        = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.slave_connection      = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.sqlite_synchronous    = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.synchronous_reader    = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] database.use_db_reconnect      = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_tracing.insecure = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.connection_string     = messaging:// {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.enabled               = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.es_doc_type           = notification {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.es_scroll_size        = 10000 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.es_scroll_time        = 2m {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.filter_error_trace    = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.hmac_keys             = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.sentinel_service_name = mymaster {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.socket_timeout        = 0.1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.trace_requests        = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler.trace_sqlalchemy      = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler_jaeger.process_tags   = {} {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler_jaeger.service_name_prefix = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] profiler_otlp.service_name_prefix = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.enforce_new_defaults = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.policy_default_rule = default {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] privsep_osbrick.group          = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] privsep_osbrick.helper_command = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] privsep_osbrick.user           = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cinder_sys_admin.group         = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cinder_sys_admin.helper_command = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] cinder_sys_admin.user          = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.auth_section      = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.auth_type         = password {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.cafile            = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.certfile          = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.collect_timing    = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.insecure          = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.keyfile           = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.send_service_user_token = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.split_loggers     = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.timeout           = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.tls_ciphers       = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] service_user.tls_min_version   = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.auth_section            = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.auth_type               = password {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.certfile                = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.collect_timing          = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.insecure                = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.keyfile                 = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.region_name             = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.split_loggers           = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.timeout                 = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.tls_ciphers             = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] glance.tls_min_version         = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.backend_availability_zone = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.chap_password = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.chap_username =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.disk_geometry = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.driver_client_cert = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.driver_client_cert_key = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.driver_data_namespace = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.driver_use_ssl = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.extra_capabilities = {} {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.filter_function = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.goodness_function = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.iscsi_target_flags =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.iscsi_write_cache = on {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.iser_ip_address = 192.168.122.183 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.iser_port     = 3260 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.lvm_share_target = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.lvm_type      = auto {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.num_shell_tries = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.replication_device = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.report_discard_supported = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.reserved_percentage = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.target_helper = tgtadm {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.target_ip_address = 192.168.122.183 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.target_port   = 3260 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.target_protocol = iscsi {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.trace_flags   = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.unique_fqdn_network = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.use_chap_auth = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volume_backend_name = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volume_clear  = zero {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volume_clear_ionice = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volume_clear_size = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_reports.file_event_handler = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_reports.log_dir           = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.backend_host       = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.chap_password      = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.chap_username      = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.disk_geometry      = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.driver_client_cert = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.extra_capabilities = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.filter_function    = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.goodness_function  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.iser_helper        = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.iser_port          = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.lvm_type           = auto {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.replication_device = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.report_discard_supported = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.reserved_percentage = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.scst_target_driver = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.storage_protocol   = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.target_ip_address  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.target_port        = 3260 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.trace_flags        = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volume_clear       = zero {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] lvmdriver-1.volumes_dir        = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_notifications.driver = [] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_notifications.retry = -1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] key_manager.fixed_key          = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.barbican_api_version  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.barbican_endpoint     = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.barbican_endpoint_type = public {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.barbican_region_name  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.cafile                = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.certfile              = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.collect_timing        = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.insecure              = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.keyfile               = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.number_of_retries     = 60 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.retry_delay           = 1 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.send_service_user_token = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.split_loggers         = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.timeout               = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.tls_ciphers           = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.tls_min_version       = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.verify_ssl            = True {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican.verify_ssl_path       = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.auth_section = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.auth_type = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.cafile   = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.certfile = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.collect_timing = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.insecure = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.keyfile  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.split_loggers = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.timeout  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.tls_ciphers = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] barbican_service_user.tls_min_version = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.approle_role_id          = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.approle_secret_id        = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.auth_method              = approle {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.auth_path                = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.kv_mountpoint            = secret {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.kv_path                  = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.kv_version               = 2 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.namespace                = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.root_token_id            = **** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.ssl_ca_crt_file          = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.timeout                  = 60.0 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.token_file               = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.token_role               = None {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.use_ssl                  = False {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:50:39 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] ******************************************************************************** {{(pid=76126) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 06 16:50:39 devstack sudo[76283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 06 16:50:39 devstack sudo[76283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:39 devstack sudo[76283]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:39 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:39 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:39 devstack sudo[76306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:50:39 devstack sudo[76306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:40 devstack sudo[76306]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:40 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.308s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:40 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 16:50:40 devstack cinder-volume[76279]: INFO cinder.brick.local_dev.lvm [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 06 16:50:40 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:40 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:40 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:40 devstack sudo[76454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 06 16:50:40 devstack sudo[76454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:40 devstack sudo[76454]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:40 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:40 devstack cinder-volume[76279]: DEBUG cinder.brick.local_dev.lvm [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76279) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 06 16:50:40 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:40 devstack sudo[76542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:50:40 devstack sudo[76542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:40 devstack sudo[76542]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:40 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.527s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:41 devstack sudo[76721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:50:41 devstack sudo[76721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:41 devstack sudo[76721]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:41 devstack sudo[76808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 06 16:50:41 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:41 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.340s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:41 devstack sudo[76899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 06 16:50:41 devstack sudo[76899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:41 devstack sudo[76899]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:41 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:41 devstack sudo[76907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 06 16:50:41 devstack sudo[76907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:42 devstack sudo[76907]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:42 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:42 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:42 devstack sudo[76986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:50:42 devstack sudo[76986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:42 devstack sudo[76986]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:42 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:42 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:42 devstack sudo[76995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:50:42 devstack sudo[76995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:42 devstack sudo[76995]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:42 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.324s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:42 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:42 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:42 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:42 devstack sudo[77079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:50:42 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:43 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:43 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:43 devstack cinder-volume[76279]: INFO cinder.volume.drivers.lvm [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 06 16:50:43 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:43 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:43 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:43 devstack sudo[77083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:50:43 devstack sudo[77083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:43 devstack sudo[77083]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:43 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:43 devstack cinder-volume[76279]: DEBUG cinder.volume.drivers.lvm [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Updating volume stats {{(pid=76279) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 06 16:50:43 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:43 devstack sudo[77092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 06 16:50:43 devstack sudo[77092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:43 devstack sudo[77092]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:43 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:43 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:43 devstack sudo[77095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:50:43 devstack sudo[77095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:44 devstack sudo[77095]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:44 devstack sudo[77098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:50:44 devstack sudo[77098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:44 devstack sudo[77098]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:44 devstack sudo[77101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:50:44 devstack sudo[77101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:44 devstack sudo[77101]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:44 devstack cinder-volume[76279]: INFO cinder.volume.driver [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Driver hasn't implemented _init_vendor_properties()
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG cinder.volume.driver [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76279) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG oslo_db.sqlalchemy.engines [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76279) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG dbcounter [-] [76279] Writer thread running {{(pid=76279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG cinder.db.api [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Building query based on filter {{(pid=76279) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG cinder.image.image_utils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76279) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 06 16:50:44 devstack cinder-volume[76279]: INFO cinder.keymgr.migration [None req-25caa65e-5549-49a0-9694-6b5a6b4670bc None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG cinder.volume.drivers.lvm [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Updating volume stats {{(pid=76279) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:44 devstack sudo[77104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 06 16:50:44 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:44 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:44 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:44 devstack sudo[77109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:50:44 devstack sudo[77109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:45 devstack sudo[77109]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:45 devstack sudo[77112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:50:45 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:45 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:45 devstack sudo[77116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:50:45 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:45 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG cinder.manager [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Notifying Schedulers of capabilities ... {{(pid=76279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:50:45 devstack cinder-volume[76279]: INFO cinder.volume.manager [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Driver initialization completed successfully.
Sep 06 16:50:45 devstack cinder-volume[76279]: INFO cinder.manager [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Initiating service 2 cleanup
Sep 06 16:50:45 devstack cinder-volume[76279]: INFO cinder.manager [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Service 2 cleanup completed.
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG cinder.service [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Creating RPC server for service cinder-volume {{(pid=76279) start /opt/stack/cinder/cinder/service.py:231}}
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG cinder.service [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76279) start /opt/stack/cinder/cinder/service.py:237}}
Sep 06 16:50:45 devstack cinder-volume[76279]: INFO cinder.volume.manager [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG cinder.volume.drivers.lvm [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Updating volume stats {{(pid=76279) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 06 16:50:45 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:46 devstack sudo[77119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 06 16:50:46 devstack sudo[77119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:46 devstack sudo[77119]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:46 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:46 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:46 devstack sudo[77124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:50:46 devstack sudo[77124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:46 devstack sudo[77124]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:46 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:46 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:46 devstack sudo[77127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:50:46 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:46 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:46 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:46 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:50:46 devstack sudo[77133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:50:46 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:50:47 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root
Sep 06 16:50:47 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:50:47 devstack cinder-volume[76279]: INFO cinder.volume.manager [None req-f2ef75a1-07e9-46eb-b603-d220ea49ec38 None None] Driver post RPC initialization completed successfully.
Sep 06 16:50:49 devstack cinder-volume[76126]: DEBUG dbcounter [-] [76126] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76126) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:50:57 devstack cinder-volume[76279]: DEBUG dbcounter [-] [76279] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:50:57 devstack cinder-volume[76279]: DEBUG dbcounter [-] [76279] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:51:21 devstack cinder-volume[76279]: DEBUG oslo_service.periodic_task [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running periodic task VolumeManager._thread_info {{(pid=76279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:51:21 devstack cinder-volume[76279]: DEBUG cinder.volume.manager [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] thread count: 6 {{(pid=76279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 16:51:21 devstack cinder-volume[76279]: DEBUG cinder.volume.manager [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] thread info: [<_MainThread(MainThread, started 133478336057472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133478225874560)>, <Thread(Thread-3 (stat_writer), started daemon 133478221527808)>, <Thread(Rabbit-heartbeat, started daemon 133478218843008)>, <Thread(Thread-5 (_runner), started daemon 133478218894144)>, <Thread(Thread-7 (_runner), started daemon 133478219024512)>] {{(pid=76279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 16:52:21 devstack cinder-volume[76279]: DEBUG oslo_service.periodic_task [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:52:21 devstack cinder-volume[76279]: DEBUG cinder.volume.drivers.lvm [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Updating volume stats {{(pid=76279) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 06 16:52:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:52:21 devstack sudo[82334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 06 16:52:21 devstack sudo[82334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:52:21 devstack sudo[82334]: pam_unix(sudo:session): session closed for user root
Sep 06 16:52:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:52:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:52:21 devstack sudo[82338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:52:21 devstack sudo[82338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:52:21 devstack sudo[82338]: pam_unix(sudo:session): session closed for user root
Sep 06 16:52:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:52:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:52:21 devstack sudo[82341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:52:21 devstack sudo[82341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:52:21 devstack sudo[82341]: pam_unix(sudo:session): session closed for user root
Sep 06 16:52:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:52:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:52:21 devstack sudo[82344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:52:21 devstack sudo[82344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:52:22 devstack sudo[82344]: pam_unix(sudo:session): session closed for user root
Sep 06 16:52:22 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:52:22 devstack cinder-volume[76279]: DEBUG cinder.manager [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Notifying Schedulers of capabilities ... {{(pid=76279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:52:22 devstack cinder-volume[76279]: DEBUG oslo_service.periodic_task [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running periodic task VolumeManager._thread_info {{(pid=76279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:52:22 devstack cinder-volume[76279]: DEBUG cinder.volume.manager [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] thread count: 6 {{(pid=76279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 16:52:22 devstack cinder-volume[76279]: DEBUG cinder.volume.manager [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] thread info: [<_MainThread(MainThread, started 133478336057472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133478225874560)>, <Thread(Thread-3 (stat_writer), started daemon 133478221527808)>, <Thread(Rabbit-heartbeat, started daemon 133478218843008)>, <Thread(Thread-5 (_runner), started daemon 133478218894144)>, <Thread(Thread-7 (_runner), started daemon 133478219024512)>] {{(pid=76279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 16:52:57 devstack cinder-volume[76279]: DEBUG dbcounter [-] [76279] Writing DB stats cinder:SELECT=1 {{(pid=76279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:52:57 devstack cinder-volume[76279]: DEBUG dbcounter [-] [76279] Writing DB stats cinder:UPDATE=1 {{(pid=76279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:53:21 devstack cinder-volume[76279]: DEBUG oslo_service.periodic_task [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:53:21 devstack cinder-volume[76279]: DEBUG cinder.volume.drivers.lvm [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Updating volume stats {{(pid=76279) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 06 16:53:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:53:21 devstack sudo[83829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 06 16:53:21 devstack sudo[83829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:53:21 devstack sudo[83829]: pam_unix(sudo:session): session closed for user root
Sep 06 16:53:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:53:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:53:21 devstack sudo[83832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:53:21 devstack sudo[83832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:53:21 devstack sudo[83832]: pam_unix(sudo:session): session closed for user root
Sep 06 16:53:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:53:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:53:21 devstack sudo[83835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:53:21 devstack sudo[83835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:53:21 devstack sudo[83835]: pam_unix(sudo:session): session closed for user root
Sep 06 16:53:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:53:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:53:21 devstack sudo[83858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:53:21 devstack sudo[83858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:53:22 devstack sudo[83858]: pam_unix(sudo:session): session closed for user root
Sep 06 16:53:22 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:53:22 devstack cinder-volume[76279]: DEBUG cinder.manager [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Notifying Schedulers of capabilities ... {{(pid=76279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:54:21 devstack cinder-volume[76279]: DEBUG oslo_service.periodic_task [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:54:21 devstack cinder-volume[76279]: DEBUG cinder.volume.drivers.lvm [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Updating volume stats {{(pid=76279) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 06 16:54:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:54:21 devstack sudo[85394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 06 16:54:21 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:54:21 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root
Sep 06 16:54:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:54:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:54:21 devstack sudo[85397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:54:21 devstack sudo[85397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:54:21 devstack sudo[85397]: pam_unix(sudo:session): session closed for user root
Sep 06 16:54:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:54:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:54:21 devstack sudo[85411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 06 16:54:21 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:54:21 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root
Sep 06 16:54:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:54:21 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:54:21 devstack sudo[85414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 06 16:54:21 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:54:22 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root
Sep 06 16:54:22 devstack cinder-volume[76279]: DEBUG oslo_concurrency.processutils [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76279) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:54:22 devstack cinder-volume[76279]: DEBUG cinder.manager [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Notifying Schedulers of capabilities ... {{(pid=76279) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:54:22 devstack cinder-volume[76279]: DEBUG oslo_service.periodic_task [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] Running periodic task VolumeManager._thread_info {{(pid=76279) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:54:22 devstack cinder-volume[76279]: DEBUG cinder.volume.manager [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] thread count: 6 {{(pid=76279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 16:54:22 devstack cinder-volume[76279]: DEBUG cinder.volume.manager [None req-5728e1e4-0d33-454a-a3c0-969436001bfe None None] thread info: [<_MainThread(MainThread, started 133478336057472)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 133478225874560)>, <Thread(Thread-3 (stat_writer), started daemon 133478221527808)>, <Thread(Rabbit-heartbeat, started daemon 133478218843008)>, <Thread(Thread-5 (_runner), started daemon 133478218894144)>, <Thread(Thread-7 (_runner), started daemon 133478219024512)>] {{(pid=76279) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 16:54:57 devstack cinder-volume[76279]: DEBUG dbcounter [-] [76279] Writing DB stats cinder:SELECT=1 {{(pid=76279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:54:57 devstack cinder-volume[76279]: DEBUG dbcounter [-] [76279] Writing DB stats cinder:UPDATE=1 {{(pid=76279) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:54:57 devstack cinder-volume[76126]: INFO oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Caught SIGTERM, stopping children
Sep 06 16:54:57 devstack cinder-volume[76126]: DEBUG oslo_concurrency.lockutils [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Acquiring lock "singleton_lock" {{(pid=76126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 06 16:54:57 devstack cinder-volume[76126]: DEBUG oslo_concurrency.lockutils [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Acquired lock "singleton_lock" {{(pid=76126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 06 16:54:57 devstack cinder-volume[76126]: DEBUG oslo_concurrency.lockutils [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Releasing lock "singleton_lock" {{(pid=76126) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 06 16:54:57 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Stop services. {{(pid=76126) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 06 16:54:57 devstack cinder-volume[76126]: DEBUG oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Killing children. {{(pid=76126) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 06 16:54:57 devstack cinder-volume[76126]: INFO oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Waiting on 1 children to exit
Sep 06 16:55:00 devstack cinder-volume[76279]: DEBUG oslo_concurrency.lockutils [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Acquiring lock "singleton_lock" {{(pid=76279) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 06 16:55:00 devstack cinder-volume[76279]: DEBUG oslo_concurrency.lockutils [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Acquired lock "singleton_lock" {{(pid=76279) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 06 16:55:00 devstack cinder-volume[76279]: DEBUG oslo_concurrency.lockutils [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Releasing lock "singleton_lock" {{(pid=76279) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 06 16:55:00 devstack cinder-volume[76279]: WARNING amqp [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 06 16:55:01 devstack cinder-volume[76279]: WARNING amqp [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 06 16:55:01 devstack cinder-volume[76126]: INFO oslo_service.backend._eventlet.service [None req-be6865de-f59c-4eb2-aed3-16d8c8a252e7 None None] Child 76279 exited with status 0
Sep 06 16:55:01 devstack cinder-volume[86623]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 06 16:55:01 devstack cinder-volume[86623]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 06 16:55:01 devstack cinder-volume[86623]: we strongly recommend against using it for new projects.
Sep 06 16:55:01 devstack cinder-volume[86623]: If you are already using Eventlet, we recommend migrating to a different
Sep 06 16:55:01 devstack cinder-volume[86623]: framework.  For more detail see
Sep 06 16:55:01 devstack cinder-volume[86623]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 06 16:55:01 devstack cinder-volume[86623]:   import eventlet  # noqa
Sep 06 16:55:03 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 06 16:55:03 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 06 16:55:03 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 06 16:55:03 devstack cinder-volume[86623]: INFO dbcounter [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Registered counter for database cinder
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_db.sqlalchemy.engines [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG dbcounter [-] [86623] Writer thread running {{(pid=86623) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 06 16:55:04 devstack cinder-volume[86623]: INFO cinder.rpc [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 06 16:55:04 devstack cinder-volume[86623]: INFO cinder.rpc [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_db.sqlalchemy.engines [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:55:04 devstack cinder-volume[86623]: INFO cinder.volume.manager [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Determined volume DB was empty at startup.
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG cinder.volume.manager [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86623) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 06 16:55:04 devstack cinder-volume[86623]: INFO cinder.volume.manager [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 06 16:55:04 devstack cinder-volume[86623]: WARNING stevedore.named [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 06 16:55:04 devstack cinder-volume[86623]: WARNING castellan.key_manager [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 16:55:04 devstack cinder-volume[86623]: WARNING cinder.keymgr.conf_key_mgr [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 16:55:04 devstack cinder-volume[86623]: INFO cinder.volume.manager [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_db.sqlalchemy.engines [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86623) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:55:04 devstack cinder-volume[86623]: INFO oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Starting 1 workers
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Started child 86841 {{(pid=86623) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Full set of CONF: {{(pid=86623) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] ******************************************************************************** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Configuration options gathered from: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] ================================================================================ {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] allow_availability_zone_fallback = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] allow_compression_on_image_upload = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] allowed_direct_url_schemes     = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] api_rate_limit                 = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] auth_strategy                  = keystone {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_availability_zone      = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_host                   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_name                   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_stats_polling_interval = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backup_api_class               = cinder.backup.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backup_name_template           = backup-%s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backup_use_same_host           = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backup_use_temp_snapshot       = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] chap_password                  = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] chap_username                  =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cinder_internal_tenant_project_id = 05d62259658848db865b6f22c4ed7b48 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cinder_internal_tenant_user_id = a1a3aed31f964471a2504646aab63c44 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cluster                        = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] compression_format             = gzip {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] config_dir                     = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] config_source                  = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] control_exchange               = openstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] debug                          = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] default_availability_zone      = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] default_group_type             = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] default_volume_type            = QuobyteHD {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] disk_geometry                  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] driver_client_cert             = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] driver_client_cert_key         = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] driver_data_namespace          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] driver_ssl_cert_path           = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] driver_ssl_cert_verify         = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] driver_use_ssl                 = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] enable_new_services            = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] enable_unsupported_driver      = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] enforce_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] filter_function                = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_api_insecure            = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_api_servers             = ['http://192.168.122.183/image'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_api_ssl_compression     = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_ca_certificates_file    = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86841]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_certfile                = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_keyfile                 = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_num_retries             = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance_request_timeout         = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] goodness_function              = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] graceful_shutdown_timeout      = 5 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] group_api_class                = cinder.group.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] host                           = devstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_compress_on_upload       = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_conversion_address_space_limit = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_conversion_cpu_limit     = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_conversion_disable       = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_upload_use_cinder_backend = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_upload_use_internal_tenant = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_volume_cache_enabled     = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_volume_cache_max_count   = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] init_host_max_objects_retrieval = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] iscsi_target_flags             =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] iscsi_write_cache              = on {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] iser_helper                    = tgtadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] iser_ip_address                = 192.168.122.183 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] iser_port                      = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] log_color                      = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] log_config_append              = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] log_dir                        = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] log_file                       = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] log_options                    = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] log_rotate_interval            = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] log_rotate_interval_type       = days {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] log_rotation_type              = none {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] max_age                        = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] max_logfile_count              = 30 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] max_logfile_size_mb            = 200 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] max_over_subscription_ratio    = 20.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] message_reap_interval          = 86400 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] message_ttl                    = 2592000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] monkey_patch                   = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] monkey_patch_modules           = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] my_ip                          = 192.168.122.183 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] no_snapshot_gb_quota           = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] num_iser_scan_tries            = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] num_shell_tries                = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] num_volume_device_scan_tries   = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] nvmeof_conn_info_version       = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] nvmet_ns_id                    = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] nvmet_port_id                  = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] osapi_max_limit                = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] osapi_volume_ext_list          = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] osapi_volume_listen_port       = 8776 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] osapi_volume_use_ssl           = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] osapi_volume_workers           = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] per_volume_size_limit          = -1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] periodic_fuzzy_delay           = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] periodic_interval              = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] public_endpoint                = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] publish_errors                 = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] quota_backup_gigabytes         = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] quota_backups                  = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] quota_gigabytes                = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] quota_groups                   = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] quota_snapshots                = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] quota_volumes                  = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] rate_limit_burst               = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] rate_limit_except_level        = CRITICAL {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] rate_limit_interval            = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] reinit_driver_count            = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] replication_device             = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] report_discard_supported       = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] report_interval                = 120 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] reservation_clean_interval     = 86400 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] reservation_expire             = 86400 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] reserved_image_namespaces      = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] reserved_percentage            = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] rpc_response_timeout           = 120 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] run_external_periodic_tasks    = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] scst_target_driver             = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] scst_target_iqn_name           = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_down_time              = 720 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] shell_completion               = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] snapshot_name_template         = snapshot-%s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] split_loggers                  = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] state_path                     = /opt/stack/data/cinder {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] storage_availability_zone      = nova {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] storage_protocol               = iSCSI {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] syslog_log_facility            = LOG_USER {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] target_helper                  = lioadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] target_ip_address              = 192.168.122.183 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] target_port                    = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] target_protocol                = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] target_secondary_ip_addresses  = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] trace_flags                    = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] transport_url                  = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] until_refresh                  = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] use_chap_auth                  = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] use_default_quota_class        = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] use_journal                    = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] use_json                       = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] use_multipath_for_image_xfer   = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] use_stderr                     = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] use_syslog                     = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] verify_glance_signatures       = enabled {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_api_class               = cinder.volume.api.API {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_backend_name            = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_clear                   = zero {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_clear_ionice            = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_clear_size              = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_copy_bps_limit          = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_dd_blocksize            = 1M {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_name_template           = volume-%s {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_service_inithost_offload = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volume_usage_audit_period      = month {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] zoning_mode                    = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.auth_type   = password {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.auth_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.cache       = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.certfile    = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.insecure    = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.interface   = public {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.keyfile     = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcache_username = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.region_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.service_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.183/identity {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.backend                  = dogpile.cache.null {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.backend_argument         = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.backend_expiration_time  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.config_prefix            = cache.oslo {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.debug_cache_backend      = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.enable_retry_client      = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.enable_socket_keepalive  = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.enabled                  = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.expiration_time          = 600 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.memcache_dead_retry      = 300 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.memcache_sasl_enabled    = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.password                 = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.proxies                  = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.redis_db                 = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.redis_server             = localhost:6379 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.retry_attempts           = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.retry_delay              = 0.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.socket_keepalive_count   = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.socket_keepalive_idle    = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.socket_keepalive_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.socket_timeout           = 1.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.tls_allowed_ciphers      = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.tls_cafile               = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.tls_certfile             = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.tls_enabled              = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.tls_keyfile              = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cache.username                 = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] coordination.backend_url       = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.asyncio_connection    = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.asyncio_slave_connection = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.backend               = sqlalchemy {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.connection            = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-48338237-855d-43e6-be36-734154e07944 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.connection_debug      = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.remotefs [None req-48338237-855d-43e6-be36-734154e07944 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86841) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.connection_parameters =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.connection_recycle_time = 3600 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.connection_trace      = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.db_inc_retry_interval = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.db_max_retries        = 20 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.db_max_retry_interval = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.db_retry_interval     = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.max_overflow          = 50 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.max_pool_size         = 5 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.max_retries           = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.pool_timeout          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.retry_interval        = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.slave_connection      = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.sqlite_synchronous    = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.synchronous_reader    = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] database.use_db_reconnect      = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_tracing.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.connection_string     = messaging:// {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.enabled               = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.es_doc_type           = notification {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.es_scroll_size        = 10000 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.es_scroll_time        = 2m {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.filter_error_trace    = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.hmac_keys             = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.sentinel_service_name = mymaster {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.socket_timeout        = 0.1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.trace_requests        = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler.trace_sqlalchemy      = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler_jaeger.process_tags   = {} {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] profiler_otlp.service_name_prefix = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.policy_default_rule = default {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] privsep_osbrick.group          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] privsep_osbrick.helper_command = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] privsep_osbrick.user           = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cinder_sys_admin.group         = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cinder_sys_admin.helper_command = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] cinder_sys_admin.user          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.auth_section      = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.auth_type         = password {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.cafile            = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.certfile          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.collect_timing    = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.insecure          = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.keyfile           = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.send_service_user_token = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.split_loggers     = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.timeout           = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.tls_ciphers       = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] service_user.tls_min_version   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.auth_section            = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.auth_type               = password {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.certfile                = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.collect_timing          = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.insecure                = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.keyfile                 = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.region_name             = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.split_loggers           = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.timeout                 = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.tls_ciphers             = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] glance.tls_min_version         = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.backend_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.chap_password = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.chap_username =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.disk_geometry = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.driver_client_cert = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.driver_data_namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.driver_use_ssl = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.extra_capabilities = {} {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.filter_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.goodness_function = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.iscsi_target_flags =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.iser_ip_address = 192.168.122.183 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.iser_port     = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_host      =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_login     = admin {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_mount_options = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_password  = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_private_key =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_share_path =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.replication_device = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.report_discard_supported = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.target_helper = tgtadm {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.target_ip_address = 192.168.122.183 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.target_port   = 3260 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.target_protocol = iscsi {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.trace_flags   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.use_chap_auth = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.volume_backend_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.volume_clear  = zero {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_reports.file_event_handler = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_reports.log_dir           = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.backend_host         = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.chap_password        = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.chap_username        = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.disk_geometry        = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.driver_client_cert   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.extra_capabilities   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.filter_function      = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.goodness_function    = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.iser_helper          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.iser_ip_address      = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.iser_port            = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_host             = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_login            = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_mount_options    = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_password         = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_private_key      = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_share_path       = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.num_shell_tries      = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.replication_device   = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.report_discard_supported = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.reserved_percentage  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.scst_target_driver   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.storage_protocol     = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.target_helper        = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.target_ip_address    = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.target_port          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.target_prefix        = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.target_protocol      = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.trace_flags          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.use_chap_auth        = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.volume_clear         = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.volume_clear_size    = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] QuobyteHD.volumes_dir          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_notifications.driver = [] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] key_manager.fixed_key          = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.barbican_api_version  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.barbican_endpoint     = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.barbican_endpoint_type = public {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.barbican_region_name  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.cafile                = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.certfile              = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.collect_timing        = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.insecure              = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.keyfile               = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.number_of_retries     = 60 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.retry_delay           = 1 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.send_service_user_token = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.split_loggers         = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.timeout               = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.tls_ciphers           = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.tls_min_version       = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.verify_ssl            = True {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican.verify_ssl_path       = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.auth_section = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.auth_type = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.cafile   = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.certfile = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.collect_timing = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.insecure = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.keyfile  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.split_loggers = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.timeout  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.tls_ciphers = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] barbican_service_user.tls_min_version = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.approle_role_id          = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.approle_secret_id        = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.auth_method              = approle {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.auth_path                = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.kv_mountpoint            = secret {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.kv_path                  = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86841) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 06 16:55:04 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 06 16:55:04 devstack cinder-volume[86841]: WARNING cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.kv_version               = 2 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.namespace                = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.root_token_id            = **** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.ssl_ca_crt_file          = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.timeout                  = 60.0 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.token_file               = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.token_role               = None {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.use_ssl                  = False {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:04 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Running cmd (subprocess): mount.quobyte {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:04 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] ******************************************************************************** {{(pid=86623) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] CMD "mount.quobyte" returned: 1 in 0.101s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:55:05 devstack cinder-volume[86841]: INFO cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 ...
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 -c /etc/quobyte/client-cinder.cfg {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:05 devstack sudo[86847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 -c /etc/quobyte/client-cinder.cfg
Sep 06 16:55:05 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:55:05 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.419s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:05 devstack cinder-volume[86841]: INFO cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 succeeded
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.444s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:05 devstack sudo[86916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:55:05 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:55:05 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.256s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:05 devstack cinder-volume[86841]: INFO cinder.volume.driver [None req-48338237-855d-43e6-be36-734154e07944 None None] Driver hasn't implemented _init_vendor_properties()
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG cinder.volume.driver [None req-48338237-855d-43e6-be36-734154e07944 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6612968444824, 'free_capacity_gb': 1773.6612968444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86841) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_db.sqlalchemy.engines [None req-48338237-855d-43e6-be36-734154e07944 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86841) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG dbcounter [-] [86841] Writer thread running {{(pid=86841) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG cinder.db.api [None req-48338237-855d-43e6-be36-734154e07944 None None] Building query based on filter {{(pid=86841) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG cinder.image.image_utils [None req-48338237-855d-43e6-be36-734154e07944 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86841) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 06 16:55:05 devstack cinder-volume[86841]: INFO cinder.keymgr.migration [None req-e3aa4325-9082-415a-8881-f515b74ca24c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:55:05 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:05 devstack sudo[86920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:55:05 devstack sudo[86920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:55:06 devstack sudo[86920]: pam_unix(sudo:session): session closed for user root
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.314s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-48338237-855d-43e6-be36-734154e07944 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:55:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-48338237-855d-43e6-be36-734154e07944 None None] Driver initialization completed successfully.
Sep 06 16:55:06 devstack cinder-volume[86841]: INFO cinder.manager [None req-48338237-855d-43e6-be36-734154e07944 None None] Initiating service 3 cleanup
Sep 06 16:55:06 devstack cinder-volume[86841]: INFO cinder.manager [None req-48338237-855d-43e6-be36-734154e07944 None None] Service 3 cleanup completed.
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG cinder.service [None req-48338237-855d-43e6-be36-734154e07944 None None] Creating RPC server for service cinder-volume {{(pid=86841) start /opt/stack/cinder/cinder/service.py:231}}
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG cinder.service [None req-48338237-855d-43e6-be36-734154e07944 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86841) start /opt/stack/cinder/cinder/service.py:237}}
Sep 06 16:55:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-48338237-855d-43e6-be36-734154e07944 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-48338237-855d-43e6-be36-734154e07944 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:06 devstack sudo[86948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:55:06 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:55:06 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root
Sep 06 16:55:06 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-48338237-855d-43e6-be36-734154e07944 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.344s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:06 devstack cinder-volume[86841]: INFO cinder.volume.manager [None req-48338237-855d-43e6-be36-734154e07944 None None] Driver post RPC initialization completed successfully.
Sep 06 16:55:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-07706fab-84c2-48ea-8f0d-67e355f3fcd6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:55:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-07706fab-84c2-48ea-8f0d-67e355f3fcd6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:55:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-07706fab-84c2-48ea-8f0d-67e355f3fcd6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=86841) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:55:10 devstack cinder-volume[86841]: DEBUG cinder.volume.drivers.quobyte [None req-07706fab-84c2-48ea-8f0d-67e355f3fcd6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=86841) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:55:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-07706fab-84c2-48ea-8f0d-67e355f3fcd6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86841) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:55:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-07706fab-84c2-48ea-8f0d-67e355f3fcd6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:10 devstack sudo[87102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:55:10 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:55:10 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root
Sep 06 16:55:10 devstack cinder-volume[86841]: DEBUG oslo_concurrency.processutils [None req-07706fab-84c2-48ea-8f0d-67e355f3fcd6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.223s {{(pid=86841) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:10 devstack cinder-volume[86841]: DEBUG cinder.manager [None req-07706fab-84c2-48ea-8f0d-67e355f3fcd6 None None] Notifying Schedulers of capabilities ... {{(pid=86841) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:55:13 devstack cinder-volume[86623]: INFO oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Caught SIGTERM, stopping children
Sep 06 16:55:13 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Acquiring lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 06 16:55:13 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Acquired lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 06 16:55:13 devstack cinder-volume[86623]: DEBUG oslo_concurrency.lockutils [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Releasing lock "singleton_lock" {{(pid=86623) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 06 16:55:13 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Stop services. {{(pid=86623) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 06 16:55:13 devstack cinder-volume[86623]: DEBUG oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Killing children. {{(pid=86623) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 06 16:55:13 devstack cinder-volume[86623]: INFO oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Waiting on 1 children to exit
Sep 06 16:55:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Acquiring lock "singleton_lock" {{(pid=86841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 06 16:55:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Acquired lock "singleton_lock" {{(pid=86841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 06 16:55:14 devstack cinder-volume[86841]: DEBUG oslo_concurrency.lockutils [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Releasing lock "singleton_lock" {{(pid=86841) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 06 16:55:14 devstack cinder-volume[86841]: WARNING amqp [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 06 16:55:14 devstack cinder-volume[86841]: WARNING amqp [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 06 16:55:14 devstack cinder-volume[86623]: INFO oslo_service.backend._eventlet.service [None req-87125228-e808-4a7b-bdbb-1f4d5f8cb1b5 None None] Child 86841 exited with status 0
Sep 06 16:55:15 devstack cinder-volume[87197]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 06 16:55:15 devstack cinder-volume[87197]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 06 16:55:15 devstack cinder-volume[87197]: we strongly recommend against using it for new projects.
Sep 06 16:55:15 devstack cinder-volume[87197]: If you are already using Eventlet, we recommend migrating to a different
Sep 06 16:55:15 devstack cinder-volume[87197]: framework.  For more detail see
Sep 06 16:55:15 devstack cinder-volume[87197]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 06 16:55:15 devstack cinder-volume[87197]:   import eventlet  # noqa
Sep 06 16:55:17 devstack cinder-volume[87197]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 06 16:55:17 devstack cinder-volume[87197]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 06 16:55:17 devstack cinder-volume[87197]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87197) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 06 16:55:18 devstack cinder-volume[87197]: INFO dbcounter [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Registered counter for database cinder
Sep 06 16:55:18 devstack cinder-volume[87197]: DEBUG oslo_db.sqlalchemy.engines [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG dbcounter [-] [87197] Writer thread running {{(pid=87197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 06 16:55:19 devstack cinder-volume[87197]: INFO cinder.rpc [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 06 16:55:19 devstack cinder-volume[87197]: INFO cinder.rpc [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_db.sqlalchemy.engines [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:55:19 devstack cinder-volume[87197]: INFO cinder.volume.manager [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Determined volume DB was empty at startup.
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG cinder.volume.manager [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87197) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 06 16:55:19 devstack cinder-volume[87197]: WARNING stevedore.named [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 06 16:55:19 devstack cinder-volume[87197]: WARNING castellan.key_manager [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 16:55:19 devstack cinder-volume[87197]: WARNING cinder.keymgr.conf_key_mgr [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 06 16:55:19 devstack cinder-volume[87197]: INFO cinder.volume.manager [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_db.sqlalchemy.engines [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87197) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:55:19 devstack cinder-volume[87197]: INFO oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Starting 1 workers
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Started child 87474 {{(pid=87197) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Full set of CONF: {{(pid=87197) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] ******************************************************************************** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] Configuration options gathered from: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] ================================================================================ {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] allow_availability_zone_fallback = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] allow_compression_on_image_upload = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] allowed_direct_url_schemes     = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] api_rate_limit                 = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87474]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] auth_strategy                  = keystone {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_availability_zone      = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_host                   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_name                   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_stats_polling_interval = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backup_api_class               = cinder.backup.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backup_name_template           = backup-%s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backup_use_same_host           = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backup_use_temp_snapshot       = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] chap_password                  = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] chap_username                  =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cinder_internal_tenant_project_id = 05d62259658848db865b6f22c4ed7b48 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cinder_internal_tenant_user_id = a1a3aed31f964471a2504646aab63c44 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cluster                        = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] compression_format             = gzip {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] config_dir                     = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] config_source                  = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] control_exchange               = openstack {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] debug                          = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] default_availability_zone      = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] default_group_type             = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] default_volume_type            = QuobyteHD {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] disk_geometry                  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] driver_client_cert             = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] driver_client_cert_key         = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] driver_data_namespace          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] driver_ssl_cert_path           = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] driver_ssl_cert_verify         = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] driver_use_ssl                 = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] enable_new_services            = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] enable_unsupported_driver      = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] enforce_multipath_for_image_xfer = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] filter_function                = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_api_insecure            = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_api_servers             = ['http://192.168.122.183/image'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_api_ssl_compression     = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_ca_certificates_file    = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_certfile                = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_keyfile                 = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_num_retries             = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance_request_timeout         = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] goodness_function              = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87474) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] graceful_shutdown_timeout      = 5 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] group_api_class                = cinder.group.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] host                           = devstack {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_compress_on_upload       = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_conversion_address_space_limit = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_conversion_cpu_limit     = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_conversion_disable       = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_upload_use_cinder_backend = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_upload_use_internal_tenant = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_volume_cache_enabled     = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_volume_cache_max_count   = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] image_volume_cache_max_size_gb = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] init_host_max_objects_retrieval = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] iscsi_target_flags             =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] iscsi_write_cache              = on {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] iser_helper                    = tgtadm {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:19 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] iser_ip_address                = 192.168.122.183 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] iser_port                      = 3260 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] log_color                      = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] log_config_append              = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] log_dir                        = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] log_file                       = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] log_options                    = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] log_rotate_interval            = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] log_rotate_interval_type       = days {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] log_rotation_type              = none {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] max_age                        = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] max_logfile_count              = 30 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] max_logfile_size_mb            = 200 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] max_over_subscription_ratio    = 20.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] message_reap_interval          = 86400 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] message_ttl                    = 2592000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] migration_create_volume_timeout_secs = 300 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] monkey_patch                   = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] monkey_patch_modules           = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] my_ip                          = 192.168.122.183 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] no_snapshot_gb_quota           = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] num_iser_scan_tries            = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] num_shell_tries                = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] num_volume_device_scan_tries   = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] nvmeof_conn_info_version       = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] nvmet_ns_id                    = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] nvmet_port_id                  = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] osapi_max_limit                = 1000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] osapi_volume_ext_list          = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] osapi_volume_listen_port       = 8776 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] osapi_volume_use_ssl           = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] osapi_volume_workers           = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] per_volume_size_limit          = -1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] periodic_fuzzy_delay           = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] periodic_interval              = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] public_endpoint                = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] publish_errors                 = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] quota_backup_gigabytes         = 1000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] quota_backups                  = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] quota_gigabytes                = 1000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] quota_groups                   = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] quota_snapshots                = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] quota_volumes                  = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] rate_limit_burst               = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] rate_limit_except_level        = CRITICAL {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] rate_limit_interval            = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] reinit_driver_count            = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] replication_device             = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] report_discard_supported       = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] report_interval                = 120 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] reservation_clean_interval     = 86400 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] reservation_expire             = 86400 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] reserved_image_namespaces      = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] reserved_percentage            = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] rpc_response_timeout           = 120 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] run_external_periodic_tasks    = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] scst_target_driver             = iscsi {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] scst_target_iqn_name           = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_down_time              = 720 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] shell_completion               = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] snapshot_name_template         = snapshot-%s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] split_loggers                  = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] state_path                     = /opt/stack/data/cinder {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] storage_availability_zone      = nova {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] storage_protocol               = iSCSI {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] syslog_log_facility            = LOG_USER {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] target_helper                  = lioadm {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] target_ip_address              = 192.168.122.183 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] target_port                    = 3260 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] target_protocol                = iscsi {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] target_secondary_ip_addresses  = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] trace_flags                    = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] transport_url                  = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] until_refresh                  = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] use_chap_auth                  = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] use_default_quota_class        = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] use_journal                    = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] use_json                       = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] use_multipath_for_image_xfer   = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] use_stderr                     = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] use_syslog                     = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] verify_glance_signatures       = enabled {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_api_class               = cinder.volume.api.API {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_backend_name            = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_clear                   = zero {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_clear_ionice            = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_clear_size              = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_copy_bps_limit          = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_dd_blocksize            = 1M {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_name_template           = volume-%s {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_service_inithost_offload = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volume_usage_audit_period      = month {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] zoning_mode                    = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_concurrency.disable_process_locking = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.auth_section = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.auth_type   = password {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.auth_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87474) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.cache       = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.quobyte [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.quobyte [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Running cmd (subprocess): mount.quobyte {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.certfile    = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.include_service_catalog = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.insecure    = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.interface   = public {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.keyfile     = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_password = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcache_username = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.region_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.service_type = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.183/identity {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.backend                  = dogpile.cache.null {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.backend_argument         = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.backend_expiration_time  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.config_prefix            = cache.oslo {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.debug_cache_backend      = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.enable_retry_client      = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.enable_socket_keepalive  = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.enabled                  = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.expiration_time          = 600 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.hashclient_retry_attempts = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.memcache_dead_retry      = 300 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.memcache_sasl_enabled    = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.password                 = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.proxies                  = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.redis_db                 = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.redis_server             = localhost:6379 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.retry_attempts           = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.retry_delay              = 0.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.socket_keepalive_count   = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.socket_keepalive_idle    = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.socket_keepalive_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.socket_timeout           = 1.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.tls_allowed_ciphers      = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.tls_cafile               = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.tls_certfile             = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.tls_enabled              = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.tls_keyfile              = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cache.username                 = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] coordination.backend_url       = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.asyncio_connection    = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.asyncio_slave_connection = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.backend               = sqlalchemy {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.connection            = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.connection_debug      = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.connection_parameters =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.connection_recycle_time = 3600 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.connection_trace      = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.db_inc_retry_interval = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.db_max_retries        = 20 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.db_max_retry_interval = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.db_retry_interval     = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.max_overflow          = 50 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.max_pool_size         = 5 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.max_retries           = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.mysql_wsrep_sync_wait = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.pool_timeout          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.retry_interval        = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.slave_connection      = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.sqlite_synchronous    = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.synchronous_reader    = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] database.use_db_reconnect      = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_tracing.insecure = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.connection_string     = messaging:// {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.enabled               = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.es_doc_type           = notification {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.es_scroll_size        = 10000 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.es_scroll_time        = 2m {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.filter_error_trace    = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.hmac_keys             = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.sentinel_service_name = mymaster {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.socket_timeout        = 0.1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.trace_requests        = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler.trace_sqlalchemy      = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler_jaeger.process_tags   = {} {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler_jaeger.service_name_prefix = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] profiler_otlp.service_name_prefix = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.enforce_new_defaults = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.policy_default_rule = default {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] privsep_osbrick.group          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] privsep_osbrick.helper_command = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] privsep_osbrick.user           = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cinder_sys_admin.group         = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cinder_sys_admin.helper_command = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] cinder_sys_admin.user          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.auth_section      = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.auth_type         = password {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.cafile            = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.certfile          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.collect_timing    = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.insecure          = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.keyfile           = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.send_service_user_token = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.split_loggers     = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.timeout           = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.tls_ciphers       = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] service_user.tls_min_version   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.auth_section            = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.auth_type               = password {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.certfile                = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.collect_timing          = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.insecure                = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.keyfile                 = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.region_name             = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.split_loggers           = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.timeout                 = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.tls_ciphers             = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] glance.tls_min_version         = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.backend_availability_zone = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.chap_password = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.chap_username =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.disk_geometry = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.driver_client_cert = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.driver_client_cert_key = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.driver_data_namespace = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.driver_use_ssl = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.extra_capabilities = {} {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.filter_function = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.goodness_function = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.iscsi_target_flags =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.iscsi_write_cache = on {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.iser_ip_address = 192.168.122.183 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.iser_port     = 3260 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_host      =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_login     = admin {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_mount_options = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_password  = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_private_key =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_share_path =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.num_shell_tries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.quobyte_volume_url = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.replication_device = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.report_discard_supported = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.reserved_percentage = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.target_helper = tgtadm {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.target_ip_address = 192.168.122.183 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.target_port   = 3260 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.target_protocol = iscsi {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.trace_flags   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.unique_fqdn_network = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.use_chap_auth = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.volume_backend_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.volume_clear  = zero {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.volume_clear_ionice = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.volume_clear_size = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_reports.file_event_handler = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_reports.log_dir           = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.backend_availability_zone = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.backend_host         = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.chap_password        = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.chap_username        = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.disk_geometry        = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.driver_client_cert   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.driver_data_namespace = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.extra_capabilities   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.filter_function      = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.goodness_function    = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack sudo[87482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.iser_helper          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.iser_ip_address      = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.iser_port            = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_host             = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_login            = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_mount_options    = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_password         = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_private_key      = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_share_path       = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.num_shell_tries      = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.replication_device   = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.report_discard_supported = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.reserved_percentage  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.scst_target_driver   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.storage_protocol     = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.target_helper        = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.target_ip_address    = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.target_port          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.target_prefix        = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.target_protocol      = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.trace_flags          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.use_chap_auth        = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.volume_clear         = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.volume_clear_size    = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] QuobyteHD.volumes_dir          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] CMD "mount.quobyte" returned: 1 in 0.197s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_notifications.driver = [] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_notifications.retry = -1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] key_manager.fixed_key          = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.barbican_api_version  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.barbican_endpoint     = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.barbican_endpoint_type = public {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.barbican_region_name  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.cafile                = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.certfile              = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.collect_timing        = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.insecure              = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.keyfile               = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.number_of_retries     = 60 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.retry_delay           = 1 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.send_service_user_token = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.split_loggers         = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.timeout               = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.tls_ciphers           = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.tls_min_version       = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.verify_ssl            = True {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican.verify_ssl_path       = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.auth_section = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.auth_type = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.cafile   = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.certfile = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.collect_timing = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.insecure = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.keyfile  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.split_loggers = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.timeout  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.tls_ciphers = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] barbican_service_user.tls_min_version = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.approle_role_id          = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.approle_secret_id        = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.auth_method              = approle {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.auth_path                = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.kv_mountpoint            = secret {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.kv_path                  = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.kv_version               = 2 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.namespace                = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.root_token_id            = **** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.ssl_ca_crt_file          = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.timeout                  = 60.0 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.token_file               = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.token_role               = None {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.use_ssl                  = False {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 06 16:55:20 devstack cinder-volume[87197]: DEBUG oslo_service.backend._eventlet.service [None req-0815fdce-5e7d-49f9-b35b-1e70ef233f40 None None] ******************************************************************************** {{(pid=87197) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 06 16:55:20 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.523s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:20 devstack cinder-volume[87474]: INFO cinder.volume.driver [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Driver hasn't implemented _init_vendor_properties()
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG cinder.volume.driver [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6612968444824, 'free_capacity_gb': 1773.6612968444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87474) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 06 16:55:20 devstack cinder-volume[87474]: DEBUG oslo_db.sqlalchemy.engines [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87474) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writer thread running {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.db.api [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Building query based on filter {{(pid=87474) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87474) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:21 devstack cinder-volume[87474]: INFO cinder.keymgr.migration [None req-d141c77f-a0f4-450f-add2-ef049ba9d61e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 06 16:55:21 devstack sudo[87498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:55:21 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:55:21 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.451s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:55:21 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Driver initialization completed successfully.
Sep 06 16:55:21 devstack cinder-volume[87474]: INFO cinder.manager [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Initiating service 3 cleanup
Sep 06 16:55:21 devstack cinder-volume[87474]: INFO cinder.manager [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Service 3 cleanup completed.
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.service [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Creating RPC server for service cinder-volume {{(pid=87474) start /opt/stack/cinder/cinder/service.py:231}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.service [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87474) start /opt/stack/cinder/cinder/service.py:237}}
Sep 06 16:55:21 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:21 devstack sudo[87510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:55:21 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51384dae-353d-4834-8337-9595037c6e8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51384dae-353d-4834-8337-9595037c6e8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-51384dae-353d-4834-8337-9595037c6e8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-51384dae-353d-4834-8337-9595037c6e8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51384dae-353d-4834-8337-9595037c6e8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:55:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51384dae-353d-4834-8337-9595037c6e8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:55:21 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:55:21 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:55:22 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root
Sep 06 16:55:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.261s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5dfafdc3-e77e-40d1-83d2-91c4e28ca953 None None] Driver post RPC initialization completed successfully.
Sep 06 16:55:22 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Sep 06 16:55:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51384dae-353d-4834-8337-9595037c6e8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.242s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:55:22 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-51384dae-353d-4834-8337-9595037c6e8b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:55:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:55:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 6 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 16:55:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 16:55:29 devstack cinder-volume[87197]: DEBUG dbcounter [-] [87197] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87197) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:55:31 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=2 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:55:32 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:26 devstack sudo[88200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:56:26 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:26 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.808s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 6 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 16:56:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Flow 'volume_create_manager' (51248e9e-a43d-4720-9df3-87455d0df294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f813394-faf4-49a3-9d5a-5180a12efdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f813394-faf4-49a3-9d5a-5180a12efdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-618059276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c29f06e7b340ee8fe55eb91146842d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:56:32Z,use_quota=True,user_id='cbab566086014083995fe7be83186b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3a79d3-ea5e-4639-a73b-039fcb874b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3a79d3-ea5e-4639-a73b-039fcb874b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca39e40-825b-4d2d-b043-20c72a788a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca39e40-825b-4d2d-b043-20c72a788a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c', 'volume_name': 'volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373833b0-ca59-4320-adc9-ec0f16387265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373833b0-ca59-4320-adc9-ec0f16387265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7b3663-351a-4887-b368-f0c0cba1dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Volume e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c', 'volume_size': 1}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-618059276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7c29f06e7b340ee8fe55eb91146842d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:56:32Z,use_quota=True,user_id='cbab566086014083995fe7be83186b8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Creating volume e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:56:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:56:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:56:33 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:56:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:33 devstack sudo[88289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c 1073741824
Sep 06 16:56:33 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:34 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c 1073741824" returned: 0 in 1.860s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:35 devstack sudo[88646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c
Sep 06 16:56:35 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:35 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c" returned: 0 in 0.713s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] <== create_volume: return (2814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:56:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.821s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed7b3663-351a-4887-b368-f0c0cba1dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99970c0a-702c-4f1f-b8a6-909a5d0d7832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Volume volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c (e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c): created successfully
Sep 06 16:56:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99970c0a-702c-4f1f-b8a6-909a5d0d7832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Flow 'volume_create_manager' (51248e9e-a43d-4720-9df3-87455d0df294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:56:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a5ac6764-329c-4f77-82c0-666ce12da586 tempest-DeleteServersTestJSON-1662631789 None] Created volume successfully.
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Flow 'volume_create_manager' (2f72f1ef-046e-405b-b166-9556daee96ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c974dc5-5fa5-4b75-bf69-b4b84cb3e7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c974dc5-5fa5-4b75-bf69-b4b84cb3e7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-456766529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1caf98c9-1956-47c6-a1e6-1226e3558dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e023fd6a670043ac9e98efdd9263a15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:56:40Z,use_quota=True,user_id='29114a07e0854a59a959a2662e737362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddab069-127e-4183-8f5a-5e9112af6184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fddab069-127e-4183-8f5a-5e9112af6184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe998af9-8107-4e7b-af9a-0b0d2bc18803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe998af9-8107-4e7b-af9a-0b0d2bc18803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1caf98c9-1956-47c6-a1e6-1226e3558dd6', 'volume_name': 'volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33caabc-7d44-4843-9536-690aad4fd301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33caabc-7d44-4843-9536-690aad4fd301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94eed671-911f-4617-8ae9-d4d1787e71ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:40 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Volume 1caf98c9-1956-47c6-a1e6-1226e3558dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6', 'volume_size': 1}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-456766529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1caf98c9-1956-47c6-a1e6-1226e3558dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e023fd6a670043ac9e98efdd9263a15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:56:40Z,use_quota=True,user_id='29114a07e0854a59a959a2662e737362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Creating volume 1caf98c9-1956-47c6-a1e6-1226e3558dd6 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:56:40 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:56:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:40 devstack sudo[88755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6 1073741824
Sep 06 16:56:40 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:42 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6 1073741824" returned: 0 in 1.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:42 devstack sudo[88762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6
Sep 06 16:56:42 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:42 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6" returned: 0 in 0.524s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:56:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94eed671-911f-4617-8ae9-d4d1787e71ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01363309-27b2-4234-97d5-54b3109d0559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:42 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Volume volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6 (1caf98c9-1956-47c6-a1e6-1226e3558dd6): created successfully
Sep 06 16:56:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01363309-27b2-4234-97d5-54b3109d0559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Flow 'volume_create_manager' (2f72f1ef-046e-405b-b166-9556daee96ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:56:42 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-59a7357c-e566-4898-940c-66b5179803b0 tempest-VolumesAdminNegativeTest-1575895449 None] Created volume successfully.
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Flow 'volume_create_manager' (7720185e-3403-4cc1-b1fd-c0ccc8fff136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8d5390-3639-44c8-9f0f-9b4f110d9f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8d5390-3639-44c8-9f0f-9b4f110d9f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-785176637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0083b76-f81e-4ba1-9814-945faf7c21b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cbeecac62b48299755507a13a0a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:56:44Z,use_quota=True,user_id='e38ffb49f36948c993c35b73f104ad1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c043eb0b-a19d-445e-8d38-bb9a6abfc3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c043eb0b-a19d-445e-8d38-bb9a6abfc3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15c6b72-191e-42c5-90a4-3dd9d60ceb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15c6b72-191e-42c5-90a4-3dd9d60ceb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0083b76-f81e-4ba1-9814-945faf7c21b9', 'volume_name': 'volume-c0083b76-f81e-4ba1-9814-945faf7c21b9', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6403554-d481-4b8f-9687-a33ff2859db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6403554-d481-4b8f-9687-a33ff2859db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd21036a-adc0-421c-a914-600afc6ee876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:44 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Volume c0083b76-f81e-4ba1-9814-945faf7c21b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0083b76-f81e-4ba1-9814-945faf7c21b9', 'volume_size': 1}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-785176637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0083b76-f81e-4ba1-9814-945faf7c21b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5cbeecac62b48299755507a13a0a729',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:56:44Z,use_quota=True,user_id='e38ffb49f36948c993c35b73f104ad1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Creating volume c0083b76-f81e-4ba1-9814-945faf7c21b9 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:56:44 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:44 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9 1073741824
Sep 06 16:56:44 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:44 devstack cinder-volume[87474]: WARNING py.warnings [req-dd5e8118-ff86-451b-b7ff-e3fa7a4ae5ab req-3cfd05ec-d7df-4821-b12f-194be9e26335 tempest-DeleteServersTestJSON-1662631789 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Sep 06 16:56:44 devstack cinder-volume[87474]:   .first()
Sep 06 16:56:44 devstack cinder-volume[87474]: 
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-dd5e8118-ff86-451b-b7ff-e3fa7a4ae5ab req-3cfd05ec-d7df-4821-b12f-194be9e26335 tempest-DeleteServersTestJSON-1662631789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Acquiring lock "cinder-1caf98c9-1956-47c6-a1e6-1226e3558dd6-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "cinder-1caf98c9-1956-47c6-a1e6-1226e3558dd6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Acquiring lock "cinder-quobyte-1caf98c9-1956-47c6-a1e6-1226e3558dd6" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:56:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "cinder-quobyte-1caf98c9-1956-47c6-a1e6-1226e3558dd6" acquired by "delete_volume" :: waited 0.050s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:56:45 devstack cinder-volume[87474]: INFO oslo.privsep.daemon [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf_kff9o2/privsep.sock']
Sep 06 16:56:45 devstack sudo[88783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf_kff9o2/privsep.sock
Sep 06 16:56:45 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:45 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9 1073741824" returned: 0 in 1.210s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:45 devstack sudo[88787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9
Sep 06 16:56:45 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:46 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9" returned: 0 in 0.571s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-dd5e8118-ff86-451b-b7ff-e3fa7a4ae5ab req-3cfd05ec-d7df-4821-b12f-194be9e26335 tempest-DeleteServersTestJSON-1662631789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.558s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-dd5e8118-ff86-451b-b7ff-e3fa7a4ae5ab req-3cfd05ec-d7df-4821-b12f-194be9e26335 tempest-DeleteServersTestJSON-1662631789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd21036a-adc0-421c-a914-600afc6ee876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0083b76-f81e-4ba1-9814-945faf7c21b9', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338c2f29-081a-410d-b469-394b0b16ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:56:46 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Volume volume-c0083b76-f81e-4ba1-9814-945faf7c21b9 (c0083b76-f81e-4ba1-9814-945faf7c21b9): created successfully
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (338c2f29-081a-410d-b469-394b0b16ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Flow 'volume_create_manager' (7720185e-3403-4cc1-b1fd-c0ccc8fff136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:56:46 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ee6ac8e1-0d30-4252-b723-b0efef8d1c47 tempest-ServerRescueNegativeTestJSON-2085519765 None] Created volume successfully.
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-dd5e8118-ff86-451b-b7ff-e3fa7a4ae5ab req-3cfd05ec-d7df-4821-b12f-194be9e26335 tempest-DeleteServersTestJSON-1662631789 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3def8e9d-96bf-45b9-ad91-9216c04dcd88', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 16:56:46 devstack cinder-volume[87474]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 06 16:56:46 devstack cinder-volume[87474]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 06 16:56:46 devstack cinder-volume[87474]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 06 16:56:46 devstack cinder-volume[87474]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 06 16:56:46 devstack cinder-volume[87474]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 06 16:56:46 devstack cinder-volume[87474]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 06 16:56:46 devstack cinder-volume[87474]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 06 16:56:46 devstack cinder-volume[87474]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 06 16:56:46 devstack cinder-volume[87474]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 06 16:56:46 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-dd5e8118-ff86-451b-b7ff-e3fa7a4ae5ab req-3cfd05ec-d7df-4821-b12f-194be9e26335 tempest-DeleteServersTestJSON-1662631789 None] attachment_update completed successfully.
Sep 06 16:56:46 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:46 devstack cinder-volume[87474]: INFO oslo.privsep.daemon [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Spawned new privsep daemon via rootwrap
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Accepted privsep connection to /tmp/tmpf_kff9o2/privsep.sock {{(pid=87474) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 06 16:56:46 devstack cinder-volume[87474]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 06 16:56:46 devstack cinder-volume[87474]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 06 16:56:46 devstack cinder-volume[87474]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 06 16:56:46 devstack cinder-volume[87474]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88790
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23dd2f3-8b5b-425f-826a-2b48eefa771e]: (2,) {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81b3dd3-42b2-4986-8f38-bd43d7f583bb]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:56:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:47 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6
Sep 06 16:56:47 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:48 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6" returned: 0 in 1.436s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:48 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6
Sep 06 16:56:48 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:49 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1caf98c9-1956-47c6-a1e6-1226e3558dd6" returned: 0 in 0.817s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "cinder-quobyte-1caf98c9-1956-47c6-a1e6-1226e3558dd6" released by "delete_volume" :: held 4.223s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:56:49 devstack cinder-volume[87474]: WARNING cinder.quota [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 06 16:56:49 devstack cinder-volume[87474]: WARNING cinder.quota [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 06 16:56:49 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Created reservations ['3665dab6-3a9f-4bbb-b6f7-ec1b47595917', 'd896c53f-12b5-4f16-afbe-8dfe1b996e1a', 'ec1e15b1-a3dd-4bf0-9417-6876fca61fb2', 'c37e7438-2b07-4a80-800a-091d0aed1804'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:56:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:56:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:56:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:50 devstack sudo[89220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:56:50 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:51 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 1.055s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:51 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:56:51 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Deleted volume successfully.
Sep 06 16:56:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c74b04a9-e7fc-4d61-8fce-133c7716d920 tempest-VolumesAdminNegativeTest-1575895449 None] Lock "cinder-1caf98c9-1956-47c6-a1e6-1226e3558dd6-delete_volume" released by "delete_volume" :: held 6.363s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:56:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-c357eaec-9186-4cf1-a6fc-45867a2809e1 req-28b165b3-1edb-4e8c-9cdf-6e6c1d367bcf tempest-DeleteServersTestJSON-1662631789 None] Terminate volume connection completed successfully.
Sep 06 16:56:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-c357eaec-9186-4cf1-a6fc-45867a2809e1 req-28b165b3-1edb-4e8c-9cdf-6e6c1d367bcf tempest-DeleteServersTestJSON-1662631789 None] Deleting attachment 3def8e9d-96bf-45b9-ad91-9216c04dcd88. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 16:56:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Acquiring lock "cinder-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:56:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Lock "cinder-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:56:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Acquiring lock "cinder-quobyte-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:56:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Lock "cinder-quobyte-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:56:58 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[942b84cc-1c35-41e5-b42e-7437bc9f483b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:56:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:58 devstack sudo[89339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c
Sep 06 16:56:58 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:58 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c" returned: 0 in 0.704s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:59 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c
Sep 06 16:56:59 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:56:59 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Sep 06 16:56:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c" returned: 0 in 0.525s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:56:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Lock "cinder-quobyte-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c" released by "delete_volume" :: held 1.327s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:56:59 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Created reservations ['05f84c6e-f60f-4b75-9482-13d3a9225cf4', '3cae586a-24a0-4dd1-bd0e-99494b6a0d56', 'f93d8eb0-3674-4536-a3de-66a12fc9e6dc', '38734105-4ee9-491c-9c1d-e8c8cc8885bd'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:56:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:56:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:56:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:56:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:56:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:56:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:56:59 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:56:59 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:00 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.621s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:00 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:57:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Deleted volume successfully.
Sep 06 16:57:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b89cdc1c-1ac3-4596-971f-d9ce89ef3ca3 tempest-DeleteServersTestJSON-1662631789 None] Lock "cinder-e1f8a97b-0ccf-4ff6-846d-a0aca8b8723c-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:57:09 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:57:10 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=26,cinder:DELETE=2,cinder:SELECT=21,cinder:INSERT=5 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:57:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Acquiring lock "cinder-c0083b76-f81e-4ba1-9814-945faf7c21b9-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:57:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "cinder-c0083b76-f81e-4ba1-9814-945faf7c21b9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:57:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Acquiring lock "cinder-quobyte-c0083b76-f81e-4ba1-9814-945faf7c21b9" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:57:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "cinder-quobyte-c0083b76-f81e-4ba1-9814-945faf7c21b9" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:57:14 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c2dfa-25cb-4b0b-bd3d-c58547ab78c6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:57:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:14 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9
Sep 06 16:57:14 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:14 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9" returned: 0 in 0.499s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:14 devstack sudo[89425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9
Sep 06 16:57:14 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:15 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c0083b76-f81e-4ba1-9814-945faf7c21b9" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "cinder-quobyte-c0083b76-f81e-4ba1-9814-945faf7c21b9" released by "delete_volume" :: held 0.853s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Created reservations ['2a385f8e-5bcf-4ea7-ac54-53b14f553bc9', '940b04bc-09c7-4dca-b23c-c35f7720ebae', '0433f4e5-a8b0-4037-9462-342180826456', '468218f3-23c4-4864-9e48-2577571729e2'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:15 devstack sudo[89428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:57:15 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:15 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.379s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:57:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Deleted volume successfully.
Sep 06 16:57:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c38cfb6-e63f-402a-bfa2-bcf7e64c11be tempest-ServerRescueNegativeTestJSON-2085519765 None] Lock "cinder-c0083b76-f81e-4ba1-9814-945faf7c21b9-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:57:25 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:57:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:57:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:57:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:57:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:26 devstack sudo[89521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:57:26 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:26 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.420s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:57:32 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=11,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Flow 'volume_create_manager' (aabc417f-2b97-4e84-a126-5e48f5f9298e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7045c4-6ed6-461d-a506-1fd0fe93c5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad7045c4-6ed6-461d-a506-1fd0fe93c5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1797055746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5211e2f6-aa96-43c1-9fee-7bfa914984c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3821416b316a42ec8d5a94ffb2009fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:57:52Z,use_quota=True,user_id='9e80ef9800ba49878978e4dcc1aa1c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785dc616-4416-4ca7-8c9e-6d8a0e05ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785dc616-4416-4ca7-8c9e-6d8a0e05ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fea59a8-55b0-4860-947f-377d00319c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fea59a8-55b0-4860-947f-377d00319c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5211e2f6-aa96-43c1-9fee-7bfa914984c5', 'volume_name': 'volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a72cf27-5019-4675-ba6e-8fee834cdddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a72cf27-5019-4675-ba6e-8fee834cdddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0ff899-4138-4eb1-ad0e-703b1e8af1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:52 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Volume 5211e2f6-aa96-43c1-9fee-7bfa914984c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5', 'volume_size': 1}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1797055746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5211e2f6-aa96-43c1-9fee-7bfa914984c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3821416b316a42ec8d5a94ffb2009fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:57:52Z,use_quota=True,user_id='9e80ef9800ba49878978e4dcc1aa1c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Creating volume 5211e2f6-aa96-43c1-9fee-7bfa914984c5 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:57:52 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:57:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:52 devstack sudo[89601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5 1073741824
Sep 06 16:57:52 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Flow 'volume_create_manager' (a49b2bf2-954d-44de-adbd-c9040281ca19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984c5fb1-4034-449a-a0ee-eb13c3b814fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (984c5fb1-4034-449a-a0ee-eb13c3b814fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-416019644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48b464e-b988-412f-a228-276a8324a8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b747fe3337114e5490808b2600aad4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:57:53Z,use_quota=True,user_id='e3cb899f66ca412f8558f25fb2c014c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354eb5e9-0a04-4399-bb88-2ca004bcf56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:53 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354eb5e9-0a04-4399-bb88-2ca004bcf56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e743024-0358-4ac3-9671-7da4103ac92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e743024-0358-4ac3-9671-7da4103ac92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e48b464e-b988-412f-a228-276a8324a8a1', 'volume_name': 'volume-e48b464e-b988-412f-a228-276a8324a8a1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9b7f96-8af2-4614-b7f9-3ba0a47c9a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a9b7f96-8af2-4614-b7f9-3ba0a47c9a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d527ca-3384-46a7-86ad-93d6132f882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:53 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Volume e48b464e-b988-412f-a228-276a8324a8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e48b464e-b988-412f-a228-276a8324a8a1', 'volume_size': 1}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5 1073741824" returned: 0 in 0.998s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:53 devstack sudo[89646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5
Sep 06 16:57:53 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:54 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5" returned: 0 in 0.409s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-416019644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48b464e-b988-412f-a228-276a8324a8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b747fe3337114e5490808b2600aad4c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:57:53Z,use_quota=True,user_id='e3cb899f66ca412f8558f25fb2c014c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Creating volume e48b464e-b988-412f-a228-276a8324a8a1 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:57:54 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:54 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1 1073741824
Sep 06 16:57:54 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0ff899-4138-4eb1-ad0e-703b1e8af1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be19793f-06cd-4541-8c2a-79014afc1460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:54 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Volume volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5 (5211e2f6-aa96-43c1-9fee-7bfa914984c5): created successfully
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be19793f-06cd-4541-8c2a-79014afc1460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Flow 'volume_create_manager' (aabc417f-2b97-4e84-a126-5e48f5f9298e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:57:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-30cd558e-6de2-4790-83b7-15097198d4b5 tempest-VolumesTestJSON-168390557 None] Created volume successfully.
Sep 06 16:57:54 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1 1073741824" returned: 0 in 0.722s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:54 devstack sudo[89690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1
Sep 06 16:57:54 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:55 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1" returned: 0 in 0.459s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d527ca-3384-46a7-86ad-93d6132f882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48b464e-b988-412f-a228-276a8324a8a1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94f3f64-ba4f-42b8-9bdf-9cc7a13bcd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:55 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Volume volume-e48b464e-b988-412f-a228-276a8324a8a1 (e48b464e-b988-412f-a228-276a8324a8a1): created successfully
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94f3f64-ba4f-42b8-9bdf-9cc7a13bcd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Flow 'volume_create_manager' (a49b2bf2-954d-44de-adbd-c9040281ca19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:57:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c8a3ffe8-80a7-4a3d-b68b-c657dd68d72a tempest-TaggedAttachmentsTest-2058494613 None] Created volume successfully.
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Flow 'volume_create_manager' (a83e0f0d-f13f-4a88-ab03-ee0f62a1b2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03415420-f89c-4eed-b9cb-8ddd4f56514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03415420-f89c-4eed-b9cb-8ddd4f56514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1233781442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73762e7-e5d1-4da5-b044-2f46d8d85568,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3821416b316a42ec8d5a94ffb2009fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:57:56Z,use_quota=True,user_id='9e80ef9800ba49878978e4dcc1aa1c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdbdba2-4567-4001-b1a6-c4e577c6b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbdbdba2-4567-4001-b1a6-c4e577c6b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0407ab-9a9f-49ba-baa6-495b3d81e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0407ab-9a9f-49ba-baa6-495b3d81e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73762e7-e5d1-4da5-b044-2f46d8d85568', 'volume_name': 'volume-c73762e7-e5d1-4da5-b044-2f46d8d85568', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1e191a-6b47-4a30-9e48-24ca44bc2821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1e191a-6b47-4a30-9e48-24ca44bc2821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a21df30-9f58-4b56-9121-fe096e93363c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:55 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Volume c73762e7-e5d1-4da5-b044-2f46d8d85568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73762e7-e5d1-4da5-b044-2f46d8d85568', 'volume_size': 1}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1233781442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73762e7-e5d1-4da5-b044-2f46d8d85568,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3821416b316a42ec8d5a94ffb2009fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:57:56Z,use_quota=True,user_id='9e80ef9800ba49878978e4dcc1aa1c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Creating volume c73762e7-e5d1-4da5-b044-2f46d8d85568 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:57:55 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:57:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:55 devstack sudo[89697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568 1073741824
Sep 06 16:57:55 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:56 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568 1073741824" returned: 0 in 0.739s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:56 devstack sudo[89704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568
Sep 06 16:57:56 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:57 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568" returned: 0 in 0.467s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:57:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a21df30-9f58-4b56-9121-fe096e93363c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73762e7-e5d1-4da5-b044-2f46d8d85568', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c07c78c-b435-4945-895f-4a65b2079a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:57 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Volume volume-c73762e7-e5d1-4da5-b044-2f46d8d85568 (c73762e7-e5d1-4da5-b044-2f46d8d85568): created successfully
Sep 06 16:57:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c07c78c-b435-4945-895f-4a65b2079a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Flow 'volume_create_manager' (a83e0f0d-f13f-4a88-ab03-ee0f62a1b2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:57:57 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-568a4954-8987-4065-8ef6-4993cdb6a03b tempest-VolumesTestJSON-168390557 None] Created volume successfully.
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Flow 'volume_create_manager' (48393e6c-6f89-4bf9-bdc6-65061e2ec24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b3b419-7989-44b0-8f5d-27eebb439324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b3b419-7989-44b0-8f5d-27eebb439324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1293969064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36e3706-a7c3-43fe-beea-9317bf16b2e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3821416b316a42ec8d5a94ffb2009fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:57:59Z,use_quota=True,user_id='9e80ef9800ba49878978e4dcc1aa1c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e015fe-5783-49a6-953a-1cf37196f73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77e015fe-5783-49a6-953a-1cf37196f73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dde5d13-215e-4140-91b0-6c2239f5b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dde5d13-215e-4140-91b0-6c2239f5b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b36e3706-a7c3-43fe-beea-9317bf16b2e0', 'volume_name': 'volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765bb0ad-98a1-4a9c-8c53-656a37d3012a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765bb0ad-98a1-4a9c-8c53-656a37d3012a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b883628-9b67-4ac5-afd8-b5c814638b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:58 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Volume b36e3706-a7c3-43fe-beea-9317bf16b2e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0', 'volume_size': 1}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1293969064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b36e3706-a7c3-43fe-beea-9317bf16b2e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3821416b316a42ec8d5a94ffb2009fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:57:59Z,use_quota=True,user_id='9e80ef9800ba49878978e4dcc1aa1c12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Creating volume b36e3706-a7c3-43fe-beea-9317bf16b2e0 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:57:58 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:57:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:58 devstack sudo[89725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0 1073741824
Sep 06 16:57:58 devstack sudo[89725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:59 devstack sudo[89725]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0 1073741824" returned: 0 in 0.473s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:57:59 devstack sudo[89733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0
Sep 06 16:57:59 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:57:59 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root
Sep 06 16:57:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0" returned: 0 in 0.377s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:57:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:57:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:57:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b883628-9b67-4ac5-afd8-b5c814638b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66111673-c2a7-443f-a335-c75fd47f867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:57:59 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Volume volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0 (b36e3706-a7c3-43fe-beea-9317bf16b2e0): created successfully
Sep 06 16:57:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66111673-c2a7-443f-a335-c75fd47f867e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:57:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Flow 'volume_create_manager' (48393e6c-6f89-4bf9-bdc6-65061e2ec24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:57:59 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-98701657-915a-47e4-9457-6523d5b93305 tempest-VolumesTestJSON-168390557 None] Created volume successfully.
Sep 06 16:58:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Acquiring lock "cinder-b36e3706-a7c3-43fe-beea-9317bf16b2e0-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Lock "cinder-b36e3706-a7c3-43fe-beea-9317bf16b2e0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Acquiring lock "cinder-quobyte-b36e3706-a7c3-43fe-beea-9317bf16b2e0" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Lock "cinder-quobyte-b36e3706-a7c3-43fe-beea-9317bf16b2e0" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:03 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac07ea3-c1d5-4e6e-9b69-421257bae509]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:04 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0
Sep 06 16:58:04 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:04 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0" returned: 0 in 0.707s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:04 devstack sudo[89819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0
Sep 06 16:58:04 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:05 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b36e3706-a7c3-43fe-beea-9317bf16b2e0" returned: 0 in 0.397s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Lock "cinder-quobyte-b36e3706-a7c3-43fe-beea-9317bf16b2e0" released by "delete_volume" :: held 1.242s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Created reservations ['89351e01-16cc-4a9d-b7cb-5c579af11a14', '98921c38-a6ba-4bda-ab73-be51f6907bbb', '39555f84-e1bf-4fc9-b888-8010cdb512be', '52302864-9f73-49ed-81dc-191ea6fb99db'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:05 devstack sudo[89823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:58:05 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:05 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.610s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:58:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Deleted volume successfully.
Sep 06 16:58:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab87cb2c-fcca-45fc-a94c-35f19d6374d8 tempest-VolumesTestJSON-168390557 None] Lock "cinder-b36e3706-a7c3-43fe-beea-9317bf16b2e0-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Acquiring lock "cinder-c73762e7-e5d1-4da5-b044-2f46d8d85568-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Lock "cinder-c73762e7-e5d1-4da5-b044-2f46d8d85568-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Acquiring lock "cinder-quobyte-c73762e7-e5d1-4da5-b044-2f46d8d85568" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Lock "cinder-quobyte-c73762e7-e5d1-4da5-b044-2f46d8d85568" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:06 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e1e040-025b-4cf0-bc1f-242d87299654]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:07 devstack sudo[89830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568
Sep 06 16:58:07 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:07 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568" returned: 0 in 0.943s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:07 devstack sudo[89846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568
Sep 06 16:58:07 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:07 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c73762e7-e5d1-4da5-b044-2f46d8d85568" returned: 0 in 0.328s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Lock "cinder-quobyte-c73762e7-e5d1-4da5-b044-2f46d8d85568" released by "delete_volume" :: held 1.364s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Created reservations ['8a03b559-91b8-497d-ae22-208b37c084ab', '31e9f14b-7b9c-42ea-870b-17d004d3401a', '6a06137d-5ef0-40ef-802c-8cdffc7c15d3', '4adeef6f-a52b-408b-ab33-fc13b38f63f6'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:08 devstack sudo[89867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:58:08 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:08 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.326s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:58:08 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Deleted volume successfully.
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3ac13867-3523-4865-9d8c-55a71984b7b0 tempest-VolumesTestJSON-168390557 None] Lock "cinder-c73762e7-e5d1-4da5-b044-2f46d8d85568-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Acquiring lock "cinder-5211e2f6-aa96-43c1-9fee-7bfa914984c5-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Lock "cinder-5211e2f6-aa96-43c1-9fee-7bfa914984c5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Acquiring lock "cinder-quobyte-5211e2f6-aa96-43c1-9fee-7bfa914984c5" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Lock "cinder-quobyte-5211e2f6-aa96-43c1-9fee-7bfa914984c5" acquired by "delete_volume" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:09 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3addecfe-326a-48d0-b4b6-ca0be5c1633b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:09 devstack sudo[89881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5
Sep 06 16:58:09 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:09 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5" returned: 0 in 0.568s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:09 devstack sudo[89889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5
Sep 06 16:58:09 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:09 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5211e2f6-aa96-43c1-9fee-7bfa914984c5" returned: 0 in 0.356s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Lock "cinder-quobyte-5211e2f6-aa96-43c1-9fee-7bfa914984c5" released by "delete_volume" :: held 0.988s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:10 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Created reservations ['70161056-e6ce-4887-90cf-95faece01148', '29dd1ce9-68f8-4235-affb-0d6f55f0efe7', 'f88496a9-7382-47e6-a18e-7cb36dae493e', 'db473b54-2bb2-49a9-9ec9-6f33311b60d4'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:58:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:10 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:58:10 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:11 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.764s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:11 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:58:11 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Deleted volume successfully.
Sep 06 16:58:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-769c6b3c-1f20-4364-a124-f70fc55c5c30 tempest-VolumesTestJSON-168390557 None] Lock "cinder-5211e2f6-aa96-43c1-9fee-7bfa914984c5-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-67ecd3bc-1f0f-4831-88e8-17858c44cf90 tempest-GroupsV314Test-796381124 None] Group tempest-GroupsV314Test-Group-228159638: creating
Sep 06 16:58:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-67ecd3bc-1f0f-4831-88e8-17858c44cf90 tempest-GroupsV314Test-796381124 None] Group tempest-GroupsV314Test-Group-228159638: created successfully
Sep 06 16:58:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-67ecd3bc-1f0f-4831-88e8-17858c44cf90 tempest-GroupsV314Test-796381124 None] Create group completed successfully.
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Flow 'volume_create_manager' (8fbe70d7-09ed-473e-b70c-a438cba9bdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680e4b96-0047-4e86-9209-9a597933283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680e4b96-0047-4e86-9209-9a597933283c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1942737637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c965563e-d163-4ef7-9398-00e13a6a9f2e,host='devstack@QuobyteHD#QuobyteHD',id=b75d41f2-0dc2-4aa9-a165-61c78f402045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61814b7eded4056bf943bafe8d7c3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:58:20Z,use_quota=True,user_id='98442fb354484d6aab28284907fc2709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a710fc7a-b961-4c1c-9c71-c972c8b8b10b),volume_type_id=a710fc7a-b961-4c1c-9c71-c972c8b8b10b)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a980fc0e-e267-4b86-b619-e5617a93b170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a980fc0e-e267-4b86-b619-e5617a93b170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdb4246-a074-439c-80e7-fc68338d264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bdb4246-a074-439c-80e7-fc68338d264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75d41f2-0dc2-4aa9-a165-61c78f402045', 'volume_name': 'volume-b75d41f2-0dc2-4aa9-a165-61c78f402045', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062505ea-e08c-4fab-8ae0-78cd95e7c384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062505ea-e08c-4fab-8ae0-78cd95e7c384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d3d6e3-d2a8-45db-b8f1-767c53257f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Volume b75d41f2-0dc2-4aa9-a165-61c78f402045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75d41f2-0dc2-4aa9-a165-61c78f402045', 'volume_size': 1}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c965563e-d163-4ef7-9398-00e13a6a9f2e,created_at=2026-09-06T14:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1942737637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c965563e-d163-4ef7-9398-00e13a6a9f2e,host='devstack@QuobyteHD#QuobyteHD',id=b75d41f2-0dc2-4aa9-a165-61c78f402045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d61814b7eded4056bf943bafe8d7c3c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:58:20Z,use_quota=True,user_id='98442fb354484d6aab28284907fc2709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a710fc7a-b961-4c1c-9c71-c972c8b8b10b),volume_type_id=a710fc7a-b961-4c1c-9c71-c972c8b8b10b)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Creating volume b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:58:20 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:20 devstack sudo[90022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 1073741824
Sep 06 16:58:20 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:20 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 1073741824" returned: 0 in 0.412s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:20 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045
Sep 06 16:58:20 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:20 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045" returned: 0 in 0.283s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d3d6e3-d2a8-45db-b8f1-767c53257f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75d41f2-0dc2-4aa9-a165-61c78f402045', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1237c4-ed71-480f-8056-be02c36e5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Volume volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 (b75d41f2-0dc2-4aa9-a165-61c78f402045): created successfully
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f1237c4-ed71-480f-8056-be02c36e5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Flow 'volume_create_manager' (8fbe70d7-09ed-473e-b70c-a438cba9bdbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:58:21 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b895d482-3b8b-47b3-8ecd-78733393d036 tempest-GroupsV314Test-796381124 None] Created volume successfully.
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Flow 'volume_create_manager' (f1d8a532-74a4-467e-bd40-cef9da7549d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb33aa0-ef9c-4aa8-bc4a-39bbc81ddcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb33aa0-ef9c-4aa8-bc4a-39bbc81ddcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1044383904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d783aaa3-dde7-4ca0-9d32-2b4b429cc17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15422afcbc204b0faf73985e08eb430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:58:22Z,use_quota=True,user_id='f25d7806361e4288b9cf74800acdc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162e1dfa-be1c-4072-bcb1-294bdf3f5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162e1dfa-be1c-4072-bcb1-294bdf3f5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf380660-e6c9-4ca2-83c5-b16268c3eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf380660-e6c9-4ca2-83c5-b16268c3eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd783aaa3-dde7-4ca0-9d32-2b4b429cc17e', 'volume_name': 'volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f36ffe-6fb8-4d2a-b778-4fce3c2c1f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f36ffe-6fb8-4d2a-b778-4fce3c2c1f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cde752-edfc-4d1b-87f3-73c0100060a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:21 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Volume d783aaa3-dde7-4ca0-9d32-2b4b429cc17e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e', 'volume_size': 1}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1044383904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d783aaa3-dde7-4ca0-9d32-2b4b429cc17e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15422afcbc204b0faf73985e08eb430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:58:22Z,use_quota=True,user_id='f25d7806361e4288b9cf74800acdc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Creating volume d783aaa3-dde7-4ca0-9d32-2b4b429cc17e {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:58:22 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:22 devstack sudo[90034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e 1073741824
Sep 06 16:58:22 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:22 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e 1073741824" returned: 0 in 0.625s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:22 devstack sudo[90040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e
Sep 06 16:58:22 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:22 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e" returned: 0 in 0.317s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.850s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:23 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Cloning volume b75d41f2-0dc2-4aa9-a165-61c78f402045 to volume 382ebb2b-f330-44db-8d91-c2c0adde1c00
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cde752-edfc-4d1b-87f3-73c0100060a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4503fb-b9b9-4991-976f-932536cb9282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:23 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Volume volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e (d783aaa3-dde7-4ca0-9d32-2b4b429cc17e): created successfully
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4503fb-b9b9-4991-976f-932536cb9282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Flow 'volume_create_manager' (f1d8a532-74a4-467e-bd40-cef9da7549d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Creating offline snapshot 239e01af-2bed-4b9a-b608-43cf9a9421e3 of volume b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 16:58:23 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-488df4ac-5de4-4d5a-83ec-9af87554d7fa tempest-ServerActionsTestOtherA-1388397706 None] Created volume successfully.
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[747dd7cf-17e4-4ff0-9414-1f7eef78ec91]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:23 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045
Sep 06 16:58:23 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:23 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045" returned: 0 in 0.461s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:23 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 1G
Sep 06 16:58:23 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:24 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 1G" returned: 0 in 0.483s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:24 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3
Sep 06 16:58:24 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:24 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3" returned: 0 in 0.312s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:24 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 16:58:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:24 devstack sudo[90061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3
Sep 06 16:58:24 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:24 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3" returned: 0 in 0.250s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:24 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.info
Sep 06 16:58:24 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:25 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.info" returned: 0 in 0.494s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:25 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:25 devstack sudo[90070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.info
Sep 06 16:58:25 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:25 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.info" returned: 0 in 0.306s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Acquiring lock "cinder-quobyte-382ebb2b-f330-44db-8d91-c2c0adde1c00" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Lock "cinder-quobyte-382ebb2b-f330-44db-8d91-c2c0adde1c00" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] snapshot: 239e01af-2bed-4b9a-b608-43cf9a9421e3, volume: 382ebb2b-f330-44db-8d91-c2c0adde1c00,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68a0884-88d9-43bd-9c6d-ee03088b3730]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:25 devstack sudo[90073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3
Sep 06 16:58:25 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:26 devstack sudo[90080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:58:26 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:26 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3" returned: 0 in 0.616s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75d41f2-0dc2-4aa9-a165-61c78f402045(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[252ec448-b053-40cd-8c0b-e4b5a2cfeaa7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:26 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045
Sep 06 16:58:26 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:26 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.460s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 8 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 16:58:26 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045" returned: 0 in 0.602s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00 not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 16:58:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:26 devstack sudo[90090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00
Sep 06 16:58:26 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Flow 'volume_create_manager' (08e09b0a-548d-48fb-a5ca-7fda2b8bfc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce208c1-4d90-47e4-81bc-835bb75d0e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce208c1-4d90-47e4-81bc-835bb75d0e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1918000322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0077a403-d84e-4459-ace7-d93aa2491dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532f5caa669246e2b56b38a80ed11a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:58:31Z,use_quota=True,user_id='7ce20730e5f1498db18ad804054a6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78308116-870f-44df-89dd-45a2d3ddd8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78308116-870f-44df-89dd-45a2d3ddd8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4479e2a0-940a-4203-8c76-90971073f012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4479e2a0-940a-4203-8c76-90971073f012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0077a403-d84e-4459-ace7-d93aa2491dc2', 'volume_name': 'volume-0077a403-d84e-4459-ace7-d93aa2491dc2', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6aba5f-1567-402c-9408-7c8b943183f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6aba5f-1567-402c-9408-7c8b943183f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b527d90-69d3-40f2-9614-22e34e915b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:31 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Volume 0077a403-d84e-4459-ace7-d93aa2491dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0077a403-d84e-4459-ace7-d93aa2491dc2', 'volume_size': 1}
Sep 06 16:58:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:33 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00" returned: 0 in 7.009s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:33 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045, size 1024.00 MB, duration 7.01 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 16:58:33 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Converted 1024.00 MB image at 146.05 MB/s
Sep 06 16:58:33 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00 is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 16:58:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:34 devstack sudo[90187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00
Sep 06 16:58:34 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:34 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00" returned: 0 in 0.389s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Lock "cinder-quobyte-382ebb2b-f330-44db-8d91-c2c0adde1c00" released by "_copy_volume_from_snapshot" :: held 8.741s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Acquiring lock "cinder-quobyte-239e01af-2bed-4b9a-b608-43cf9a9421e3" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Lock "cinder-quobyte-239e01af-2bed-4b9a-b608-43cf9a9421e3" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Deleting offline snapshot 239e01af-2bed-4b9a-b608-43cf9a9421e3 of volume b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] snapshot_file for this snap is: volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[432ef790-a1bd-47b8-a790-1b31c8c9073b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:34 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3
Sep 06 16:58:34 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:34 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3" returned: 0 in 0.456s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b75d41f2-0dc2-4aa9-a165-61c78f402045(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e46cec6-1583-4c39-be04-5f54fe7a143f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:35 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045
Sep 06 16:58:35 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:35 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045" returned: 0 in 0.548s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:35 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3
Sep 06 16:58:35 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:35 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3" returned: 0 in 0.404s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:35 devstack sudo[90211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3
Sep 06 16:58:35 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:36 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045.239e01af-2bed-4b9a-b608-43cf9a9421e3" returned: 0 in 0.261s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Lock "cinder-quobyte-239e01af-2bed-4b9a-b608-43cf9a9421e3" released by "_delete_snapshot" :: held 1.816s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.242s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.078s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1918000322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0077a403-d84e-4459-ace7-d93aa2491dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532f5caa669246e2b56b38a80ed11a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:58:31Z,use_quota=True,user_id='7ce20730e5f1498db18ad804054a6f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Creating volume 0077a403-d84e-4459-ace7-d93aa2491dc2 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:58:36 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:36 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2 1073741824
Sep 06 16:58:36 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-bff9c45a-5d47-4370-8478-6c315ed6f68b tempest-GroupsV314Test-796381124 None] Create group from source-group-c965563e-d163-4ef7-9398-00e13a6a9f2e completed successfully.
Sep 06 16:58:36 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2 1073741824" returned: 0 in 0.566s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:36 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2
Sep 06 16:58:36 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:37 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2" returned: 0 in 0.455s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b527d90-69d3-40f2-9614-22e34e915b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0077a403-d84e-4459-ace7-d93aa2491dc2', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6288e3f-b5b4-4366-95e5-b4ec1dfd1139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:37 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Volume volume-0077a403-d84e-4459-ace7-d93aa2491dc2 (0077a403-d84e-4459-ace7-d93aa2491dc2): created successfully
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6288e3f-b5b4-4366-95e5-b4ec1dfd1139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Flow 'volume_create_manager' (08e09b0a-548d-48fb-a5ca-7fda2b8bfc00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:58:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-bea48536-40a5-477b-bbb2-2da21f539c17 tempest-AttachVolumeShelveTestJSON-1078022959 None] Created volume successfully.
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Acquiring lock "cinder-quobyte-382ebb2b-f330-44db-8d91-c2c0adde1c00" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Lock "cinder-quobyte-382ebb2b-f330-44db-8d91-c2c0adde1c00" acquired by "delete_volume" :: waited 0.053s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7931924-4fcf-4ce3-8824-b37f6b848ef4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:37 devstack sudo[90230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00
Sep 06 16:58:37 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:38 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00" returned: 0 in 0.527s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:38 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00
Sep 06 16:58:38 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:38 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-382ebb2b-f330-44db-8d91-c2c0adde1c00" returned: 0 in 0.292s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Lock "cinder-quobyte-382ebb2b-f330-44db-8d91-c2c0adde1c00" released by "delete_volume" :: held 0.912s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Created reservations ['a6f33a8e-6ff0-452b-be83-af68bfc661e7'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:58:38 devstack cinder-volume[87474]: WARNING cinder.quota [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1628494234 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1628494234, it is now deprecated. Please use the default quota class for default quota.
Sep 06 16:58:38 devstack cinder-volume[87474]: WARNING cinder.quota [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1628494234 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1628494234, it is now deprecated. Please use the default quota class for default quota.
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Created reservations ['3430e446-fc8e-4f9b-a259-3b4969b91c01', '6727038c-a49c-4fd9-a496-dd5fe163a763', 'a625d2c9-828c-4ed3-9f7d-f32011b21a17', 'fe439025-466e-457b-bbd4-c49b025e8bbc'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:38 devstack sudo[90238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:58:38 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:39 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.293s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:39 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:58:39 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-027cc748-d101-489a-a86b-fbad25f256cc tempest-GroupsV314Test-796381124 None] Delete group completed successfully.
Sep 06 16:58:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Acquiring lock "cinder-quobyte-b75d41f2-0dc2-4aa9-a165-61c78f402045" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:58:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Lock "cinder-quobyte-b75d41f2-0dc2-4aa9-a165-61c78f402045" acquired by "delete_volume" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:58:40 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca4303-5a00-4d0c-96c1-f6d51e94e165]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:58:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:40 devstack sudo[90255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045
Sep 06 16:58:40 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:40 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045" returned: 0 in 0.472s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:40 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045
Sep 06 16:58:40 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:41 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b75d41f2-0dc2-4aa9-a165-61c78f402045" returned: 0 in 0.281s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Lock "cinder-quobyte-b75d41f2-0dc2-4aa9-a165-61c78f402045" released by "delete_volume" :: held 0.832s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Created reservations ['3be1f5c4-dbcd-42a3-8529-0f3aaa98d6cc'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Created reservations ['d43b5d48-1c97-486a-a185-f5d3a3f3dbb1', '71876055-eeed-465a-87ac-5aeb2a61e161', '868a90e8-80a9-43d9-9de4-74bac13a3cbc', '2c0f332c-4888-444a-9ddf-6b2369c9c124'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:41 devstack sudo[90265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:58:41 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:41 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.307s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:41 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:58:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1cb9b800-be22-403a-94a0-770e3d84a47b tempest-GroupsV314Test-796381124 None] Delete group completed successfully.
Sep 06 16:58:47 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=65,cinder:SELECT=50,cinder:DELETE=4,cinder:INSERT=16 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:58:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-01839a9e-80a8-4e2a-8684-fae8083af30c req-13e308e2-6f96-4525-98df-1f4e9b359e09 tempest-AttachVolumeShelveTestJSON-1078022959 None] No connector for attachment 0d3b99fa-2e6f-44d1-b509-d2fd4908ce06; skipping storage backend terminate_connection call. {{(pid=87474) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 06 16:58:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-01839a9e-80a8-4e2a-8684-fae8083af30c req-13e308e2-6f96-4525-98df-1f4e9b359e09 tempest-AttachVolumeShelveTestJSON-1078022959 None] Deleting attachment 0d3b99fa-2e6f-44d1-b509-d2fd4908ce06. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 16:58:57 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=60,cinder:UPDATE=77,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Flow 'volume_create_manager' (6efb0713-5757-4dec-a75d-ee957561f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c13221-8af2-4bd8-9cc2-b48cdb293b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c13221-8af2-4bd8-9cc2-b48cdb293b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1658259153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a04d17aa2464bbf939e1465702dea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:58:58Z,use_quota=True,user_id='61f12a6259b94b899bbd1a1a28491772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427c910b-d48d-41de-a63f-bbbf6bd315b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (427c910b-d48d-41de-a63f-bbbf6bd315b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2248ed-fc77-408c-af74-2e95824dc906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2248ed-fc77-408c-af74-2e95824dc906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab', 'volume_name': 'volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3edcd5-09dc-42de-9bff-bba8ac93aed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc3edcd5-09dc-42de-9bff-bba8ac93aed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9154abb-89a8-40d7-bb0b-f93c6f5ee914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:58:58 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab', 'volume_size': 1}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T14:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1658259153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a04d17aa2464bbf939e1465702dea42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T14:58:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T14:58:58Z,use_quota=True,user_id='61f12a6259b94b899bbd1a1a28491772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Creating volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 16:58:58 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 16:58:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:58 devstack sudo[90508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab 1073741824
Sep 06 16:58:58 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:58:59 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root
Sep 06 16:58:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab 1073741824" returned: 0 in 0.876s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:58:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:58:59 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab
Sep 06 16:58:59 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:00 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" returned: 0 in 0.681s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9154abb-89a8-40d7-bb0b-f93c6f5ee914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9883f5f-8b41-42e6-9bbd-96e4b0fc0144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-21bb3a3f-61ef-4ba4-af62-87cb2dac51c5 req-9375b9ef-4a5c-47bf-9f38-899d7760e7fc tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-21bb3a3f-61ef-4ba4-af62-87cb2dac51c5 req-9375b9ef-4a5c-47bf-9f38-899d7760e7fc tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:00 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Volume volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab (2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab): created successfully
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9883f5f-8b41-42e6-9bbd-96e4b0fc0144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Flow 'volume_create_manager' (6efb0713-5757-4dec-a75d-ee957561f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-21bb3a3f-61ef-4ba4-af62-87cb2dac51c5 req-9375b9ef-4a5c-47bf-9f38-899d7760e7fc tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-10195377-8397-4354-8d89-04c68002cb44 tempest-SnapshotsActionsTest-1195022466 None] Created volume successfully.
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-21bb3a3f-61ef-4ba4-af62-87cb2dac51c5 req-9375b9ef-4a5c-47bf-9f38-899d7760e7fc tempest-ServerActionsTestOtherA-1388397706 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10cb18b5-0989-483d-a589-6e20d6b2b05a', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 16:59:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-21bb3a3f-61ef-4ba4-af62-87cb2dac51c5 req-9375b9ef-4a5c-47bf-9f38-899d7760e7fc tempest-ServerActionsTestOtherA-1388397706 None] attachment_update completed successfully.
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-a7da63d6-56a4-46d1-ba9e-7d2df4fe197e req-f9a6a420-d95a-4112-9b25-488e81034c44 tempest-TaggedAttachmentsTest-2058494613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-a7da63d6-56a4-46d1-ba9e-7d2df4fe197e req-f9a6a420-d95a-4112-9b25-488e81034c44 tempest-TaggedAttachmentsTest-2058494613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-a7da63d6-56a4-46d1-ba9e-7d2df4fe197e req-f9a6a420-d95a-4112-9b25-488e81034c44 tempest-TaggedAttachmentsTest-2058494613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-a7da63d6-56a4-46d1-ba9e-7d2df4fe197e req-f9a6a420-d95a-4112-9b25-488e81034c44 tempest-TaggedAttachmentsTest-2058494613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-e48b464e-b988-412f-a228-276a8324a8a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49195ceb-0edc-4625-b66e-2dd0e3f7e21d', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 16:59:01 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-a7da63d6-56a4-46d1-ba9e-7d2df4fe197e req-f9a6a420-d95a-4112-9b25-488e81034c44 tempest-TaggedAttachmentsTest-2058494613 None] attachment_update completed successfully.
Sep 06 16:59:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Creating offline snapshot 608318e0-1dae-47f0-a2b0-859179de426b of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 16:59:01 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9364c6fc-84dc-40a3-8a27-b92e213535f1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:01 devstack sudo[90940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab
Sep 06 16:59:01 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:02 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" returned: 0 in 0.899s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:02 devstack sudo[90947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b 1G
Sep 06 16:59:02 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:02 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b 1G" returned: 0 in 0.553s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:02 devstack sudo[90952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:02 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:03 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.471s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:03 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b is being set with open permissions: ugo+rw
Sep 06 16:59:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:03 devstack sudo[90961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:03 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:03 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.515s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:03 devstack sudo[90967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.info
Sep 06 16:59:03 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:04 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.info" returned: 0 in 0.479s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:04 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.info is being set with open permissions: ugo+rw
Sep 06 16:59:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:04 devstack sudo[90972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.info
Sep 06 16:59:04 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:04 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.info" returned: 0 in 0.417s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.557s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:04 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0adb2e99-e255-4ec0-b5e4-ae7bf92c1b79 tempest-SnapshotsActionsTest-1195022466 None] Create snapshot completed successfully
Sep 06 16:59:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-0641ade4-0449-40b8-b439-c400dbd22837 req-f91af472-700f-4d7f-8ff6-141dea33b082 tempest-TaggedAttachmentsTest-2058494613 None] Terminate volume connection completed successfully.
Sep 06 16:59:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-0641ade4-0449-40b8-b439-c400dbd22837 req-f91af472-700f-4d7f-8ff6-141dea33b082 tempest-TaggedAttachmentsTest-2058494613 None] Deleting attachment 49195ceb-0edc-4625-b66e-2dd0e3f7e21d. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 16:59:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-6db32bf3-0724-490f-bcc0-a6cbdc1dc0ba req-673e81b0-4715-4328-8276-4ddda23651cd tempest-ServerActionsTestOtherA-1388397706 None] Terminate volume connection completed successfully.
Sep 06 16:59:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-6db32bf3-0724-490f-bcc0-a6cbdc1dc0ba req-673e81b0-4715-4328-8276-4ddda23651cd tempest-ServerActionsTestOtherA-1388397706 None] Deleting attachment 10cb18b5-0989-483d-a589-6e20d6b2b05a. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 16:59:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-6db32bf3-0724-490f-bcc0-a6cbdc1dc0ba req-cb449aaf-1161-438c-8f81-c418aecd8a19 tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Creating offline snapshot 9ed97043-1649-49ae-a45c-c8e30eaa385a of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 16:59:07 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[54970ca7-b7ff-4671-8aff-abf5b9a956aa]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:07 devstack sudo[91052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:07 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:07 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.575s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:08 devstack sudo[91060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a 1G
Sep 06 16:59:08 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:08 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a 1G" returned: 0 in 0.531s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:08 devstack sudo[91067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a
Sep 06 16:59:08 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:08 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a" returned: 0 in 0.350s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:08 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a is being set with open permissions: ugo+rw
Sep 06 16:59:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:08 devstack sudo[91072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a
Sep 06 16:59:08 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:09 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-6db32bf3-0724-490f-bcc0-a6cbdc1dc0ba req-cb449aaf-1161-438c-8f81-c418aecd8a19 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.845s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-6db32bf3-0724-490f-bcc0-a6cbdc1dc0ba req-cb449aaf-1161-438c-8f81-c418aecd8a19 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:09 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ecc12e85-350a-4190-87c9-1082b0e6e57d tempest-SnapshotsActionsTest-1195022466 None] Create snapshot completed successfully
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-6db32bf3-0724-490f-bcc0-a6cbdc1dc0ba req-cb449aaf-1161-438c-8f81-c418aecd8a19 tempest-ServerActionsTestOtherA-1388397706 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2af6ec30-7067-4c24-91c9-1a5fd5cba4a4', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 16:59:09 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-6db32bf3-0724-490f-bcc0-a6cbdc1dc0ba req-cb449aaf-1161-438c-8f81-c418aecd8a19 tempest-ServerActionsTestOtherA-1388397706 None] attachment_update completed successfully.
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-9ed97043-1649-49ae-a45c-c8e30eaa385a-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-9ed97043-1649-49ae-a45c-c8e30eaa385a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-quobyte-9ed97043-1649-49ae-a45c-c8e30eaa385a" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-9ed97043-1649-49ae-a45c-c8e30eaa385a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Deleting offline snapshot 9ed97043-1649-49ae-a45c-c8e30eaa385a of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] snapshot_file for this snap is: volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[530a650f-3673-4564-b729-c6a90c3315ca]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:09 devstack sudo[91077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a
Sep 06 16:59:09 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:10 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a" returned: 0 in 0.598s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:10 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[61daa891-d4f0-491b-bd00-3ab481deb2f4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:10 devstack sudo[91094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:10 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:10 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.464s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:10 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a
Sep 06 16:59:10 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:11 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a" returned: 0 in 0.836s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:11 devstack sudo[91520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a
Sep 06 16:59:11 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:12 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.9ed97043-1649-49ae-a45c-c8e30eaa385a" returned: 0 in 0.676s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-9ed97043-1649-49ae-a45c-c8e30eaa385a" released by "_delete_snapshot" :: held 2.786s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" released by "delete_snapshot" :: held 2.833s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:12 devstack cinder-volume[87474]: WARNING cinder.quota [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 06 16:59:12 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Created reservations ['e5854e18-2aa3-4130-a481-c8ab761295fe', '29e0858a-9470-4f53-9821-4af14ebc9000', '68018b08-1046-41cc-8be5-5528130f42a4', '01174846-96fe-4151-ba26-bb75fac69ffd'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:59:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Delete snapshot completed successfully.
Sep 06 16:59:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b9db08c-188f-49fe-af6f-0195f4a1934b tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-9ed97043-1649-49ae-a45c-c8e30eaa385a-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Creating offline snapshot 813609f1-88d7-447b-b263-45d77084a5f1 of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 16:59:13 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a444c99-05c1-4226-917b-ab0e236c736d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:13 devstack sudo[91563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:13 devstack sudo[91563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:14 devstack sudo[91563]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.656s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:14 devstack sudo[91571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 1G
Sep 06 16:59:14 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:14 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 1G" returned: 0 in 0.600s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:14 devstack sudo[91580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1
Sep 06 16:59:14 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:15 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1" returned: 0 in 0.345s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:15 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 is being set with open permissions: ugo+rw
Sep 06 16:59:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:15 devstack sudo[91585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1
Sep 06 16:59:15 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:15 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-31ac7d1b-cc2d-4119-9133-7a36db1747d5 tempest-SnapshotsActionsTest-1195022466 None] Create snapshot completed successfully
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-813609f1-88d7-447b-b263-45d77084a5f1-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-813609f1-88d7-447b-b263-45d77084a5f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-quobyte-813609f1-88d7-447b-b263-45d77084a5f1" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-813609f1-88d7-447b-b263-45d77084a5f1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Deleting offline snapshot 813609f1-88d7-447b-b263-45d77084a5f1 of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] snapshot_file for this snap is: volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4714e22a-02ad-4031-a6a4-2661f8a7d7fd]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:16 devstack sudo[91591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1
Sep 06 16:59:16 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:17 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1" returned: 0 in 0.381s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:17 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a444fab-dc3a-4181-8e95-9a61d49d4d44]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:17 devstack sudo[91599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:17 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:17 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.483s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:17 devstack sudo[91607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1
Sep 06 16:59:17 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:18 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1" returned: 0 in 0.476s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:18 devstack sudo[91612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1
Sep 06 16:59:18 devstack sudo[91612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:18 devstack sudo[91612]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.813609f1-88d7-447b-b263-45d77084a5f1" returned: 0 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-813609f1-88d7-447b-b263-45d77084a5f1" released by "_delete_snapshot" :: held 1.802s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" released by "delete_snapshot" :: held 1.835s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:18 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Created reservations ['d893959b-be65-48da-836b-bf47393b5186', 'd95639c6-2845-4f7d-87f6-ab9383669759', '41ad5d64-a388-4aec-b79e-e7822ee8a41c', 'd031d11a-5f78-4e30-bdb7-62b71e9ad6c0'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:59:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Delete snapshot completed successfully.
Sep 06 16:59:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a5af1394-dcaf-4e2d-97b2-de38c4d3951c tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-813609f1-88d7-447b-b263-45d77084a5f1-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Creating offline snapshot e798e93d-1eee-4195-94f5-1a7eaecf847d of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Acquiring lock "cinder-e48b464e-b988-412f-a228-276a8324a8a1-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Lock "cinder-e48b464e-b988-412f-a228-276a8324a8a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de0325f-b491-4b3c-9ed7-a23616ba51c3]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Acquiring lock "cinder-quobyte-e48b464e-b988-412f-a228-276a8324a8a1" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Lock "cinder-quobyte-e48b464e-b988-412f-a228-276a8324a8a1" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[894e319b-1a03-4827-815c-21cd0b7aa45b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:19 devstack sudo[91625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:19 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:19 devstack sudo[91631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1
Sep 06 16:59:19 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:20 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1" returned: 0 in 0.388s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:20 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.515s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:20 devstack sudo[91646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1
Sep 06 16:59:20 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:20 devstack sudo[91647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d 1G
Sep 06 16:59:20 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:20 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e48b464e-b988-412f-a228-276a8324a8a1" returned: 0 in 0.315s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Lock "cinder-quobyte-e48b464e-b988-412f-a228-276a8324a8a1" released by "delete_volume" :: held 0.762s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Created reservations ['2702ef6d-7db0-4e22-8f53-b4e9a53990f0', '80f1ab3c-c1fe-494c-8728-baaad3190a52', 'b9fbb87d-2764-47d2-97d0-2ef07f3c9e79', '2b24b954-1277-41ab-9d04-5aa2e63f972e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:20 devstack sudo[91658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:59:20 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:20 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d 1G" returned: 0 in 0.567s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:20 devstack sudo[91660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d
Sep 06 16:59:20 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:20 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.360s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:20 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:59:21 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Deleted volume successfully.
Sep 06 16:59:21 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-637fbc12-df14-43cd-8a2d-30d389af50c0 tempest-TaggedAttachmentsTest-2058494613 None] Lock "cinder-e48b464e-b988-412f-a228-276a8324a8a1-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d" returned: 0 in 0.329s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:21 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d is being set with open permissions: ugo+rw
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:21 devstack sudo[91668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d
Sep 06 16:59:21 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:21 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d" returned: 0 in 0.253s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:21 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e5192fce-3768-490b-84b9-5237a775f242 tempest-SnapshotsActionsTest-1195022466 None] Create snapshot completed successfully
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-e798e93d-1eee-4195-94f5-1a7eaecf847d-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-e798e93d-1eee-4195-94f5-1a7eaecf847d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-quobyte-e798e93d-1eee-4195-94f5-1a7eaecf847d" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-e798e93d-1eee-4195-94f5-1a7eaecf847d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Deleting offline snapshot e798e93d-1eee-4195-94f5-1a7eaecf847d of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] snapshot_file for this snap is: volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d0bde-4397-46c1-9824-7ea6998eb261]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:22 devstack sudo[91673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d
Sep 06 16:59:22 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:22 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d" returned: 0 in 0.524s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:22 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4252d87-dae1-4a46-bd65-c205453da26f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:22 devstack sudo[91685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:22 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:23 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.805s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:23 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d
Sep 06 16:59:23 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:23 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d" returned: 0 in 0.497s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:23 devstack sudo[91716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d
Sep 06 16:59:23 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:24 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.e798e93d-1eee-4195-94f5-1a7eaecf847d" returned: 0 in 0.376s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-e798e93d-1eee-4195-94f5-1a7eaecf847d" released by "_delete_snapshot" :: held 2.362s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" released by "delete_snapshot" :: held 2.404s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:24 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Created reservations ['18fe33b1-d1da-4e79-a881-28cfa9be5518', '68f64b3d-cc92-47d4-ad5b-1d106b1ce99c', '7792609b-fe92-4d7d-9df3-c0dad4411305', 'bb558eb3-9827-4724-9836-931e113424c9'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:59:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Delete snapshot completed successfully.
Sep 06 16:59:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df84e0ee-1e21-4fcc-afce-5656961a720a tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-e798e93d-1eee-4195-94f5-1a7eaecf847d-delete_snapshot" released by "delete_snapshot" :: held 2.688s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Creating offline snapshot 91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 16:59:25 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1765c603-13ae-44f7-9e69-5934cc5ebe2f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:25 devstack sudo[91724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:25 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:25 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.459s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:26 devstack sudo[91729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 1G
Sep 06 16:59:26 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:26 devstack sudo[91731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:59:26 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:26 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.573s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 9 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 16:59:26 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 1G" returned: 0 in 0.822s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:26 devstack sudo[91755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603
Sep 06 16:59:26 devstack sudo[91755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Acquiring lock "cinder-0077a403-d84e-4459-ace7-d93aa2491dc2-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "cinder-0077a403-d84e-4459-ace7-d93aa2491dc2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Acquiring lock "cinder-quobyte-0077a403-d84e-4459-ace7-d93aa2491dc2" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "cinder-quobyte-0077a403-d84e-4459-ace7-d93aa2491dc2" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53005a6-53c0-4385-ba68-cd703889ee49]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:27 devstack sudo[91755]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603" returned: 0 in 0.455s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:27 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 is being set with open permissions: ugo+rw
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:27 devstack sudo[91762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603
Sep 06 16:59:27 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:27 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2
Sep 06 16:59:27 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:27 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603" returned: 0 in 0.306s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:27 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2" returned: 0 in 0.445s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-504d1043-3d4c-47db-af69-37012a24e879 tempest-SnapshotsActionsTest-1195022466 None] Create snapshot completed successfully
Sep 06 16:59:27 devstack sudo[91770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2
Sep 06 16:59:27 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:27 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0077a403-d84e-4459-ace7-d93aa2491dc2" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "cinder-quobyte-0077a403-d84e-4459-ace7-d93aa2491dc2" released by "delete_volume" :: held 0.761s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Created reservations ['d56cd635-bfb3-419c-9939-f07df848acc0', 'b7f123f4-5c5d-4c65-a074-6187e0cc4aba', '22d36ffa-8de9-466d-ad71-3cafe1325268', '714b1822-2a1d-409b-9808-0b4e3abfa1c9'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:28 devstack sudo[91773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:59:28 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:28 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.252s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:59:28 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Deleted volume successfully.
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3b64852-87b4-4fff-a543-263ece891d6d tempest-AttachVolumeShelveTestJSON-1078022959 None] Lock "cinder-0077a403-d84e-4459-ace7-d93aa2491dc2-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Acquiring lock "cinder-quobyte-91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Deleting offline snapshot 91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] snapshot_file for this snap is: volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b298c0-2879-4724-b4ea-dff3510d9048]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:28 devstack sudo[91776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603
Sep 06 16:59:28 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:29 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603" returned: 0 in 0.442s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:29 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[874a7049-3493-4dd8-b410-5eb9a70eb0d7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:29 devstack sudo[91782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:29 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:29 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.379s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:29 devstack sudo[91788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603
Sep 06 16:59:29 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:30 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603" returned: 0 in 0.457s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:30 devstack sudo[91795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603
Sep 06 16:59:30 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:30 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603" returned: 0 in 0.288s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603" released by "_delete_snapshot" :: held 1.681s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" released by "delete_snapshot" :: held 1.707s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:30 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Created reservations ['ffd765a7-5953-4184-beeb-30d9e622c660', 'e67d129c-8519-47c8-ad44-90bbc21273d1', '5ed5883c-c5b7-4f92-b8fb-e7b5cc19f3a0', '95554cb8-f748-44ab-9bf6-b8f72cfc5942'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:59:30 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Delete snapshot completed successfully.
Sep 06 16:59:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4a25dea-1a04-4211-9fae-c5b2b750d47e tempest-SnapshotsActionsTest-1947743002 None] Lock "cinder-91a4bfe2-2e24-43f9-a2c6-5dc2e25a6603-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "cinder-608318e0-1dae-47f0-a2b0-859179de426b-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-608318e0-1dae-47f0-a2b0-859179de426b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "cinder-quobyte-608318e0-1dae-47f0-a2b0-859179de426b" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-quobyte-608318e0-1dae-47f0-a2b0-859179de426b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Deleting offline snapshot 608318e0-1dae-47f0-a2b0-859179de426b of volume 2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] snapshot_file for this snap is: volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0998fb4c-8cd6-4da2-9e73-51494cf8123e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:31 devstack sudo[91823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:31 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:31 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.384s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[469473d4-c2cd-4579-9e11-6de074e54e5f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:32 devstack sudo[91828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab
Sep 06 16:59:32 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:32 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" returned: 0 in 0.462s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:32 devstack sudo[91833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:32 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:32 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.437s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:32 devstack sudo[91840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b
Sep 06 16:59:32 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:33 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab.608318e0-1dae-47f0-a2b0-859179de426b" returned: 0 in 0.321s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-quobyte-608318e0-1dae-47f0-a2b0-859179de426b" released by "_delete_snapshot" :: held 1.751s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" released by "delete_snapshot" :: held 1.771s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Created reservations ['0f003fc9-344d-4f69-b220-ceee205959c4', 'f4665f8d-8930-4a1f-84ee-3a64db8c1fa2', '0e469b9e-9a29-43f9-974c-acb5bfdacc6b', '5fb2619f-e999-4eff-b43c-c46612ae9009'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:59:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Delete snapshot completed successfully.
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9472b633-76d1-4411-a312-3977c6fd3f92 tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-608318e0-1dae-47f0-a2b0-859179de426b-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "cinder-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b5d88-1f41-4a75-b72f-f41cad6460f0]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 16:59:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:33 devstack sudo[91844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab
Sep 06 16:59:33 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:34 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" returned: 0 in 0.452s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:34 devstack sudo[91850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab
Sep 06 16:59:34 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:34 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" returned: 0 in 0.329s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-quobyte-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab" released by "delete_volume" :: held 0.862s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Created reservations ['252f673d-dea3-444b-b84e-77c3ff35355b', 'ceb13eb6-460a-40d5-a116-de4ba5dba275', '1d4b8180-d834-4b98-a8bd-8f8cd09d04b8', '06845764-a131-4fdb-8197-aec6d40417da'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 16:59:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 16:59:34 devstack sudo[91853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 16:59:34 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 16:59:35 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root
Sep 06 16:59:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.380s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 16:59:35 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 16:59:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Deleted volume successfully.
Sep 06 16:59:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c5022ca3-6d9f-452c-b0f5-098454d67f5a tempest-SnapshotsActionsTest-1195022466 None] Lock "cinder-2eecfa49-4ebf-4ea1-9d36-ebc5433a62ab-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 16:59:44 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=78,cinder:UPDATE=64,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:59:45 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=74,cinder:UPDATE=66,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 16:59:52 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-4cd4b586-8afc-47d8-928f-b8650633e5f2 req-19316f30-6c41-4f47-9a85-0362ff52d2c6 tempest-ServerActionsTestOtherA-1388397706 None] Terminate volume connection completed successfully.
Sep 06 16:59:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-4cd4b586-8afc-47d8-928f-b8650633e5f2 req-19316f30-6c41-4f47-9a85-0362ff52d2c6 tempest-ServerActionsTestOtherA-1388397706 None] Deleting attachment 2af6ec30-7067-4c24-91c9-1a5fd5cba4a4. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:00:02 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=2 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:00:05 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:00:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Flow 'volume_create_manager' (70d279ec-f263-4337-81df-736622ee5157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:00:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171f5b01-d6bb-44e4-bb88-d6006ac64b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171f5b01-d6bb-44e4-bb88-d6006ac64b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-590655013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a82b16-6e15-4280-821e-1d8e03e139f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15422afcbc204b0faf73985e08eb430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:00:05Z,use_quota=True,user_id='f25d7806361e4288b9cf74800acdc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0750c9-3318-4ec2-a581-85b5293146de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0750c9-3318-4ec2-a581-85b5293146de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acc787f-cdea-413e-9fb1-57409df351a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:05 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:00:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acc787f-cdea-413e-9fb1-57409df351a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e5a82b16-6e15-4280-821e-1d8e03e139f8', 'volume_name': 'volume-e5a82b16-6e15-4280-821e-1d8e03e139f8', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008b7e060>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be655a6-b9a5-458b-9e63-36428eaa30b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be655a6-b9a5-458b-9e63-36428eaa30b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265511a7-4c33-475d-a0c5-af6565a1de2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:06 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Volume e5a82b16-6e15-4280-821e-1d8e03e139f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e5a82b16-6e15-4280-821e-1d8e03e139f8', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008b7e060>}
Sep 06 17:00:06 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Trying to clone e5a82b16-6e15-4280-821e-1d8e03e139f8 from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:00:06 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:00:06 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Image download 20.69 MB at 20.69 MB/s
Sep 06 17:00:07 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e15df6-6cd8-4c72-a324-c4fe7d3aa7d8]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:00:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:07 devstack sudo[92138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD
Sep 06 17:00:07 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:07 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD" returned: 0 in 0.572s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:07 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf is fetched for user f25d7806361e4288b9cf74800acdc0be. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:00:07 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[660f876d-0bc6-475d-9bc6-bfef563a9b9a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:00:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:07 devstack sudo[92145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD
Sep 06 17:00:07 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:08 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-590655013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a82b16-6e15-4280-821e-1d8e03e139f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15422afcbc204b0faf73985e08eb430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:00:05Z,use_quota=True,user_id='f25d7806361e4288b9cf74800acdc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Creating volume e5a82b16-6e15-4280-821e-1d8e03e139f8 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:00:08 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:08 devstack sudo[92152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 1073741824
Sep 06 17:00:08 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:08 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 1073741824" returned: 0 in 0.650s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:09 devstack sudo[92158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8
Sep 06 17:00:09 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:09 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8" returned: 0 in 0.553s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:00:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:09 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Attempting download of 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume e5a82b16-6e15-4280-821e-1d8e03e139f8. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:00:09 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3def09-b8af-4e63-842f-bb769135c2e1]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:00:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_5lda7oy0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:09 devstack sudo[92161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_5lda7oy0
Sep 06 17:00:09 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:10 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_5lda7oy0" returned: 0 in 0.538s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_5lda7oy0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:10 devstack sudo[92166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_5lda7oy0
Sep 06 17:00:10 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:10 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_5lda7oy0" returned: 1 in 0.678s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_5lda7oy0' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:00:10 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c71eaa4-67e3-48cb-9a44-02e7a440c210]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:00:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:11 devstack sudo[92170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD
Sep 06 17:00:11 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:11 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD" returned: 0 in 0.594s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:11 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] 23f4b67c-17a9-402c-a0ff-7560fceb54cf was qcow2, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:00:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:11 devstack sudo[92177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8
Sep 06 17:00:11 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:14 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8" returned: 0 in 3.056s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:14 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_j1zl2mb6devstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:00:14 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Converted 112.00 MB image at 36.64 MB/s
Sep 06 17:00:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:14 devstack sudo[92188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 1G
Sep 06 17:00:14 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:15 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 1G" returned: 0 in 0.735s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Downloaded image 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume e5a82b16-6e15-4280-821e-1d8e03e139f8 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf for user f25d7806361e4288b9cf74800acdc0be is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Marking volume e5a82b16-6e15-4280-821e-1d8e03e139f8 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Copying metadata from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf to e5a82b16-6e15-4280-821e-1d8e03e139f8. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Creating volume glance metadata for volume e5a82b16-6e15-4280-821e-1d8e03e139f8 backed by image 23f4b67c-17a9-402c-a0ff-7560fceb54cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265511a7-4c33-475d-a0c5-af6565a1de2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a82b16-6e15-4280-821e-1d8e03e139f8', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008b7e060>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19328744-2f6f-4619-9c4f-499bd27e9200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:15 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Volume volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 (e5a82b16-6e15-4280-821e-1d8e03e139f8): created successfully
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19328744-2f6f-4619-9c4f-499bd27e9200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Flow 'volume_create_manager' (70d279ec-f263-4337-81df-736622ee5157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:00:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6889b8d4-1de6-407f-a1b4-dc8e8eb87386 tempest-ServerActionsTestOtherA-1388397706 None] Created volume successfully.
Sep 06 17:00:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-960040a0-f299-4ebb-a233-8e235abe6911 req-29f313a1-efb8-4887-b7a3-0952ece9d915 tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-960040a0-f299-4ebb-a233-8e235abe6911 req-29f313a1-efb8-4887-b7a3-0952ece9d915 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-960040a0-f299-4ebb-a233-8e235abe6911 req-29f313a1-efb8-4887-b7a3-0952ece9d915 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-960040a0-f299-4ebb-a233-8e235abe6911 req-29f313a1-efb8-4887-b7a3-0952ece9d915 tempest-ServerActionsTestOtherA-1388397706 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-e5a82b16-6e15-4280-821e-1d8e03e139f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1957337-0df7-4a88-8f4f-758d900a4529', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:00:21 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-960040a0-f299-4ebb-a233-8e235abe6911 req-29f313a1-efb8-4887-b7a3-0952ece9d915 tempest-ServerActionsTestOtherA-1388397706 None] attachment_update completed successfully.
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:26 devstack sudo[92693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:00:26 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:26 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.316s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:00:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Flow 'volume_create_manager' (bfaeec96-6143-4bd9-b274-5d209fee8136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c57bf81-9931-4ae7-8edf-93b34c874ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c57bf81-9931-4ae7-8edf-93b34c874ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1456863352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882d9e7b-4869-45a8-b749-af07c97a5fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b421adef30ab484f9ab3c94acb66ea17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:00:30Z,use_quota=True,user_id='bf445686762c4711b6b22265e2160b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61f0708-f4ba-43f2-9a32-2e4f9e1e0369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c61f0708-f4ba-43f2-9a32-2e4f9e1e0369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142680fa-f5ca-4efb-97db-0e874ab39fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142680fa-f5ca-4efb-97db-0e874ab39fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882d9e7b-4869-45a8-b749-af07c97a5fed', 'volume_name': 'volume-882d9e7b-4869-45a8-b749-af07c97a5fed', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331090e6-60d1-4c1b-ac09-41fd498f99c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331090e6-60d1-4c1b-ac09-41fd498f99c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af91486-f902-4cf8-b3bd-473136e641cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:30 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Volume 882d9e7b-4869-45a8-b749-af07c97a5fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882d9e7b-4869-45a8-b749-af07c97a5fed', 'volume_size': 1}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1456863352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882d9e7b-4869-45a8-b749-af07c97a5fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b421adef30ab484f9ab3c94acb66ea17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:00:30Z,use_quota=True,user_id='bf445686762c4711b6b22265e2160b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Creating volume 882d9e7b-4869-45a8-b749-af07c97a5fed {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:00:30 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:00:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:30 devstack sudo[92706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed 1073741824
Sep 06 17:00:30 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:31 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed 1073741824" returned: 0 in 0.698s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:31 devstack sudo[92715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed
Sep 06 17:00:31 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:31 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed" returned: 0 in 0.561s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:00:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af91486-f902-4cf8-b3bd-473136e641cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882d9e7b-4869-45a8-b749-af07c97a5fed', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc595c41-a3e1-4e43-a568-237428fae8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:31 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Volume volume-882d9e7b-4869-45a8-b749-af07c97a5fed (882d9e7b-4869-45a8-b749-af07c97a5fed): created successfully
Sep 06 17:00:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc595c41-a3e1-4e43-a568-237428fae8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Flow 'volume_create_manager' (bfaeec96-6143-4bd9-b274-5d209fee8136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:00:31 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ec807705-b93c-49ec-aa75-6bc09e91c1a4 tempest-AttachVolumeTestJSON-1172774509 None] Created volume successfully.
Sep 06 17:00:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-58e853a7-5f02-45ea-9692-f85c92b00307 req-ee0876ef-a99b-4538-a95e-6ca700b58e58 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-58e853a7-5f02-45ea-9692-f85c92b00307 req-ee0876ef-a99b-4538-a95e-6ca700b58e58 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-58e853a7-5f02-45ea-9692-f85c92b00307 req-ee0876ef-a99b-4538-a95e-6ca700b58e58 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-58e853a7-5f02-45ea-9692-f85c92b00307 req-ee0876ef-a99b-4538-a95e-6ca700b58e58 tempest-AttachVolumeTestJSON-1172774509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-882d9e7b-4869-45a8-b749-af07c97a5fed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd962f0d3-ac6f-41df-aa2a-210c8d696f91', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:00:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-58e853a7-5f02-45ea-9692-f85c92b00307 req-ee0876ef-a99b-4538-a95e-6ca700b58e58 tempest-AttachVolumeTestJSON-1172774509 None] attachment_update completed successfully.
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Flow 'volume_create_manager' (7a31c04d-4410-4358-981e-49162e54edf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fbfd7d-ab56-42af-910c-82d44b270ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46fbfd7d-ab56-42af-910c-82d44b270ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-472612758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba358da2-1012-47f8-a9b1-07e6d160848a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383c492582234c45a975f2f668d38fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:00:35Z,use_quota=True,user_id='bab2f2b3c5044b17a1ed6eda3f2d2aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e17d44-ab79-4947-9180-d94384ad12cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e17d44-ab79-4947-9180-d94384ad12cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7e8bb6-ded0-4f02-8b9e-d9485f35cbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7e8bb6-ded0-4f02-8b9e-d9485f35cbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba358da2-1012-47f8-a9b1-07e6d160848a', 'volume_name': 'volume-ba358da2-1012-47f8-a9b1-07e6d160848a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c090a90-f217-45b5-9cd6-1e5351be705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c090a90-f217-45b5-9cd6-1e5351be705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8613b09-680b-4d13-929e-4265f338db01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Volume ba358da2-1012-47f8-a9b1-07e6d160848a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba358da2-1012-47f8-a9b1-07e6d160848a', 'volume_size': 1}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-472612758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba358da2-1012-47f8-a9b1-07e6d160848a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383c492582234c45a975f2f668d38fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:00:35Z,use_quota=True,user_id='bab2f2b3c5044b17a1ed6eda3f2d2aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Creating volume ba358da2-1012-47f8-a9b1-07e6d160848a {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:00:35 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:00:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:35 devstack sudo[92744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a 1073741824
Sep 06 17:00:35 devstack sudo[92744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:36 devstack sudo[92744]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a 1073741824" returned: 0 in 1.169s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:36 devstack sudo[92757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a
Sep 06 17:00:36 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:37 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a" returned: 0 in 0.596s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:00:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8613b09-680b-4d13-929e-4265f338db01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba358da2-1012-47f8-a9b1-07e6d160848a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fccea9a-c98a-46ee-b0db-0e3b2a1711b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:37 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Volume volume-ba358da2-1012-47f8-a9b1-07e6d160848a (ba358da2-1012-47f8-a9b1-07e6d160848a): created successfully
Sep 06 17:00:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fccea9a-c98a-46ee-b0db-0e3b2a1711b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Flow 'volume_create_manager' (7a31c04d-4410-4358-981e-49162e54edf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:00:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-83ae9f32-6c4a-414a-a17b-0938c643b2d5 tempest-AttachVolumeNegativeTest-543811115 None] Created volume successfully.
Sep 06 17:00:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-720b4222-9e5e-4f18-b922-ef22238ebb2e req-456b0c75-b533-4bb5-be09-97bffea2901e tempest-ServerActionsTestOtherA-1388397706 None] Terminate volume connection completed successfully.
Sep 06 17:00:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-720b4222-9e5e-4f18-b922-ef22238ebb2e req-456b0c75-b533-4bb5-be09-97bffea2901e tempest-ServerActionsTestOtherA-1388397706 None] Deleting attachment b1957337-0df7-4a88-8f4f-758d900a4529. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:00:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-edc695b4-bd8d-4da6-9936-391081f67ecf req-ae4c1f9f-e135-4a39-9996-f03273faacce tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-edc695b4-bd8d-4da6-9936-391081f67ecf req-ae4c1f9f-e135-4a39-9996-f03273faacce tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-edc695b4-bd8d-4da6-9936-391081f67ecf req-ae4c1f9f-e135-4a39-9996-f03273faacce tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-edc695b4-bd8d-4da6-9936-391081f67ecf req-ae4c1f9f-e135-4a39-9996-f03273faacce tempest-AttachVolumeNegativeTest-543811115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-ba358da2-1012-47f8-a9b1-07e6d160848a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '355dc54b-00b2-48f4-933c-d1ab2222701a', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:00:39 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-edc695b4-bd8d-4da6-9936-391081f67ecf req-ae4c1f9f-e135-4a39-9996-f03273faacce tempest-AttachVolumeNegativeTest-543811115 None] attachment_update completed successfully.
Sep 06 17:00:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-edc695b4-bd8d-4da6-9936-391081f67ecf req-6705b045-83f6-4601-8e41-133d3d87e9c8 tempest-AttachVolumeNegativeTest-543811115 None] Terminate volume connection completed successfully.
Sep 06 17:00:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-edc695b4-bd8d-4da6-9936-391081f67ecf req-6705b045-83f6-4601-8e41-133d3d87e9c8 tempest-AttachVolumeNegativeTest-543811115 None] Deleting attachment 355dc54b-00b2-48f4-933c-d1ab2222701a. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:00:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-720b4222-9e5e-4f18-b922-ef22238ebb2e req-3b5c60ca-84a3-41d7-aecb-aa24c993402e tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-720b4222-9e5e-4f18-b922-ef22238ebb2e req-3b5c60ca-84a3-41d7-aecb-aa24c993402e tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-720b4222-9e5e-4f18-b922-ef22238ebb2e req-3b5c60ca-84a3-41d7-aecb-aa24c993402e tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-720b4222-9e5e-4f18-b922-ef22238ebb2e req-3b5c60ca-84a3-41d7-aecb-aa24c993402e tempest-ServerActionsTestOtherA-1388397706 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-e5a82b16-6e15-4280-821e-1d8e03e139f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44111a49-b622-4038-aa8d-bb236e5a1bd5', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:00:42 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-720b4222-9e5e-4f18-b922-ef22238ebb2e req-3b5c60ca-84a3-41d7-aecb-aa24c993402e tempest-ServerActionsTestOtherA-1388397706 None] attachment_update completed successfully.
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=15,cinder:SELECT=39,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=44,cinder:UPDATE=18,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (69e15cb5-7392-4048-8020-8ee069956835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ab0792-55b2-4f58-8379-b5dcbe6e2d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ab0792-55b2-4f58-8379-b5dcbe6e2d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360404823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c568a63b-bca4-41e5-ba55-e965a21ea1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:00:53Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab68d855-c176-47bc-885b-d26d57ad04ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab68d855-c176-47bc-885b-d26d57ad04ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01564c59-d55b-4c27-bc96-d3b9be4b600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01564c59-d55b-4c27-bc96-d3b9be4b600b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c568a63b-bca4-41e5-ba55-e965a21ea1dd', 'volume_name': 'volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ad28dd-c19c-46bc-b540-d9e6d15538d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ad28dd-c19c-46bc-b540-d9e6d15538d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569d256e-deb1-4db3-9100-3c35597e3278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:52 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Volume c568a63b-bca4-41e5-ba55-e965a21ea1dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd', 'volume_size': 1}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1360404823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c568a63b-bca4-41e5-ba55-e965a21ea1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:00:53Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Creating volume c568a63b-bca4-41e5-ba55-e965a21ea1dd {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:00:52 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:00:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:52 devstack sudo[93534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd 1073741824
Sep 06 17:00:52 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:53 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd 1073741824" returned: 0 in 0.571s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:53 devstack sudo[93540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd
Sep 06 17:00:53 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:53 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd" returned: 0 in 0.441s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:00:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569d256e-deb1-4db3-9100-3c35597e3278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d85816-a957-451d-8835-36c2af862025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:00:53 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Volume volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd (c568a63b-bca4-41e5-ba55-e965a21ea1dd): created successfully
Sep 06 17:00:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50d85816-a957-451d-8835-36c2af862025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:00:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (69e15cb5-7392-4048-8020-8ee069956835) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:00:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4eb32b87-0af3-4ff0-868b-db05d16403b8 tempest-VolumesActionsTest-546496587 None] Created volume successfully.
Sep 06 17:00:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-58301649-8b1c-471d-8107-bbd22044f370 tempest-VolumesActionsTest-546496587 None] Acquiring lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd" by "attach_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:00:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-58301649-8b1c-471d-8107-bbd22044f370 tempest-VolumesActionsTest-546496587 None] Lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd" acquired by "attach_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:00:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-58301649-8b1c-471d-8107-bbd22044f370 tempest-VolumesActionsTest-546496587 None] Attaching volume c568a63b-bca4-41e5-ba55-e965a21ea1dd to instance 5ef3f771-e03a-4ad3-bf6a-e73269bbbb8e at mountpoint /dev/vdb on host None.
Sep 06 17:00:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-58301649-8b1c-471d-8107-bbd22044f370 tempest-VolumesActionsTest-546496587 None] Attach volume completed successfully.
Sep 06 17:00:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-58301649-8b1c-471d-8107-bbd22044f370 tempest-VolumesActionsTest-546496587 None] Lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd" released by "attach_volume" :: held 0.136s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:00:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6ba17b6e-dd1b-4392-8efa-935f1d0ce23f tempest-VolumesActionsTest-1095995201 None] Terminate volume connection completed successfully.
Sep 06 17:00:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6ba17b6e-dd1b-4392-8efa-935f1d0ce23f tempest-VolumesActionsTest-1095995201 None] Acquiring lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd-detach_volume" by "detach_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:00:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6ba17b6e-dd1b-4392-8efa-935f1d0ce23f tempest-VolumesActionsTest-1095995201 None] Lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:00:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6ba17b6e-dd1b-4392-8efa-935f1d0ce23f tempest-VolumesActionsTest-1095995201 None] Detaching volume c568a63b-bca4-41e5-ba55-e965a21ea1dd from instance 5ef3f771-e03a-4ad3-bf6a-e73269bbbb8e.
Sep 06 17:00:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6ba17b6e-dd1b-4392-8efa-935f1d0ce23f tempest-VolumesActionsTest-1095995201 None] Detach volume completed successfully.
Sep 06 17:00:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6ba17b6e-dd1b-4392-8efa-935f1d0ce23f tempest-VolumesActionsTest-1095995201 None] Lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:00:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c724d62b-6798-4abb-908e-baa1c7b89c02 tempest-VolumesActionsTest-546496587 None] Acquiring lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd-detach_volume" by "detach_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:00:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c724d62b-6798-4abb-908e-baa1c7b89c02 tempest-VolumesActionsTest-546496587 None] Lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:00:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c724d62b-6798-4abb-908e-baa1c7b89c02 tempest-VolumesActionsTest-546496587 None] Volume detach called, but volume not attached.
Sep 06 17:00:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c724d62b-6798-4abb-908e-baa1c7b89c02 tempest-VolumesActionsTest-546496587 None] Lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:00:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Acquiring lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:00:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:00:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Acquiring lock "cinder-quobyte-c568a63b-bca4-41e5-ba55-e965a21ea1dd" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:00:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Lock "cinder-quobyte-c568a63b-bca4-41e5-ba55-e965a21ea1dd" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:00:56 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3279b036-dc1a-4ec8-9baf-2b582dc01a4f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:00:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:56 devstack sudo[93580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd
Sep 06 17:00:56 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:57 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd" returned: 0 in 0.485s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:57 devstack sudo[93586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd
Sep 06 17:00:57 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:57 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c568a63b-bca4-41e5-ba55-e965a21ea1dd" returned: 0 in 0.256s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Lock "cinder-quobyte-c568a63b-bca4-41e5-ba55-e965a21ea1dd" released by "delete_volume" :: held 0.801s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Created reservations ['8c40f534-58da-44f5-aebe-ecc9f78acdcf', '1c55af55-11e1-42b3-abf3-bdd6b2aa163d', 'bca8b5d8-1d96-45d7-8665-a573055ad227', 'e987eee6-a537-446e-87f4-d47875980cc0'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:00:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:00:57 devstack sudo[93589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:00:57 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:00:58 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root
Sep 06 17:00:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.531s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:00:58 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:00:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Deleted volume successfully.
Sep 06 17:00:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4f3d3b8e-f187-49b2-93e1-420910870a58 tempest-VolumesActionsTest-546496587 None] Lock "cinder-c568a63b-bca4-41e5-ba55-e965a21ea1dd-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (08b03b3b-8622-4552-b2b9-e7049c2d7a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0450646e-886a-46cf-aa9c-ec40f3b69271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0450646e-886a-46cf-aa9c-ec40f3b69271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-556346496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7918ee-5c29-4786-9b51-2db7b6076f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:01Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0078b2-1909-4bbf-bcb7-f29ebad19087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0078b2-1909-4bbf-bcb7-f29ebad19087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69906508-9ffb-4798-afc7-542cd805918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69906508-9ffb-4798-afc7-542cd805918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a7918ee-5c29-4786-9b51-2db7b6076f85', 'volume_name': 'volume-5a7918ee-5c29-4786-9b51-2db7b6076f85', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e59d5d2-9177-4ce8-aa06-324d43611852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e59d5d2-9177-4ce8-aa06-324d43611852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa8f438-3e30-45c2-85e5-a13ddb7a68e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:01 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Volume 5a7918ee-5c29-4786-9b51-2db7b6076f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a7918ee-5c29-4786-9b51-2db7b6076f85', 'volume_size': 1}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-556346496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a7918ee-5c29-4786-9b51-2db7b6076f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:01Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Creating volume 5a7918ee-5c29-4786-9b51-2db7b6076f85 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:01:01 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:01 devstack sudo[93652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85 1073741824
Sep 06 17:01:01 devstack sudo[93652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:01 devstack sudo[93652]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85 1073741824" returned: 0 in 0.436s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:01 devstack sudo[93657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85
Sep 06 17:01:01 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:02 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa8f438-3e30-45c2-85e5-a13ddb7a68e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a7918ee-5c29-4786-9b51-2db7b6076f85', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f9e13d-2578-44aa-a6cc-10e2462f836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Volume volume-5a7918ee-5c29-4786-9b51-2db7b6076f85 (5a7918ee-5c29-4786-9b51-2db7b6076f85): created successfully
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f9e13d-2578-44aa-a6cc-10e2462f836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (08b03b3b-8622-4552-b2b9-e7049c2d7a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:02 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6e16d574-c011-4258-bef2-c41d876ba10c tempest-VolumesActionsTest-546496587 None] Created volume successfully.
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Acquiring lock "cinder-5a7918ee-5c29-4786-9b51-2db7b6076f85-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Lock "cinder-5a7918ee-5c29-4786-9b51-2db7b6076f85-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Acquiring lock "cinder-quobyte-5a7918ee-5c29-4786-9b51-2db7b6076f85" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Lock "cinder-quobyte-5a7918ee-5c29-4786-9b51-2db7b6076f85" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4425ccc-4d32-4dcd-8671-224d7360e22d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:02 devstack sudo[93660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85
Sep 06 17:01:02 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:02 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85" returned: 0 in 0.379s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:02 devstack sudo[93665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85
Sep 06 17:01:02 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:03 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5a7918ee-5c29-4786-9b51-2db7b6076f85" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Lock "cinder-quobyte-5a7918ee-5c29-4786-9b51-2db7b6076f85" released by "delete_volume" :: held 0.693s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Created reservations ['62e46b25-ff2f-4432-bda9-b3941453d368', 'ca0f0a9c-5799-4d37-9259-c8c72a408f47', '7ad3a8be-1849-4408-a130-ae68a5ffe992', '10695617-054b-4d33-9f46-3a70f244cb28'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:03 devstack sudo[93668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:01:03 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:03 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.298s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:01:03 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Deleted volume successfully.
Sep 06 17:01:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a058f6d2-0a65-4f08-b7ec-0157a4615c0e tempest-VolumesActionsTest-1095995201 None] Lock "cinder-5a7918ee-5c29-4786-9b51-2db7b6076f85-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (58d378d6-428b-408b-9351-de9ad550d64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2ed99e-7b00-432b-a3c4-be9465279630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2ed99e-7b00-432b-a3c4-be9465279630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-872804985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9548487-b447-4da1-95f7-3ef8d3643936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:04Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e710235e-7380-4c6d-a3bb-b006aaa6eea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e710235e-7380-4c6d-a3bb-b006aaa6eea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00611d7d-9ef6-48e9-bed2-19a381596947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00611d7d-9ef6-48e9-bed2-19a381596947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9548487-b447-4da1-95f7-3ef8d3643936', 'volume_name': 'volume-a9548487-b447-4da1-95f7-3ef8d3643936', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047fe9b8-185c-4b37-9e58-0cbf113789f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047fe9b8-185c-4b37-9e58-0cbf113789f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdde11e-513e-4399-8f62-8247ba112bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:04 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Volume a9548487-b447-4da1-95f7-3ef8d3643936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9548487-b447-4da1-95f7-3ef8d3643936', 'volume_size': 1}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-872804985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9548487-b447-4da1-95f7-3ef8d3643936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:04Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Creating volume a9548487-b447-4da1-95f7-3ef8d3643936 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:01:04 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:04 devstack sudo[93672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936 1073741824
Sep 06 17:01:04 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:04 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936 1073741824" returned: 0 in 0.540s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:04 devstack sudo[93678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936
Sep 06 17:01:04 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:05 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936" returned: 0 in 0.301s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:01:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdde11e-513e-4399-8f62-8247ba112bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9548487-b447-4da1-95f7-3ef8d3643936', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364893d7-4413-4ccf-8a06-8fe2ab510b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:05 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Volume volume-a9548487-b447-4da1-95f7-3ef8d3643936 (a9548487-b447-4da1-95f7-3ef8d3643936): created successfully
Sep 06 17:01:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (364893d7-4413-4ccf-8a06-8fe2ab510b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (58d378d6-428b-408b-9351-de9ad550d64d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-51d30644-6c6b-43dc-98fd-b52fea06a677 tempest-VolumesActionsTest-546496587 None] Created volume successfully.
Sep 06 17:01:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Acquiring lock "cinder-a9548487-b447-4da1-95f7-3ef8d3643936-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Lock "cinder-a9548487-b447-4da1-95f7-3ef8d3643936-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Acquiring lock "cinder-quobyte-a9548487-b447-4da1-95f7-3ef8d3643936" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Lock "cinder-quobyte-a9548487-b447-4da1-95f7-3ef8d3643936" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:06 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfe2efa-ae30-48d8-aa83-c23d5426fdc0]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:01:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:06 devstack sudo[93691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936
Sep 06 17:01:06 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:06 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936" returned: 0 in 0.407s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:06 devstack sudo[93696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936
Sep 06 17:01:06 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:07 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a9548487-b447-4da1-95f7-3ef8d3643936" returned: 0 in 0.282s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Lock "cinder-quobyte-a9548487-b447-4da1-95f7-3ef8d3643936" released by "delete_volume" :: held 0.735s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Created reservations ['8ebf34e2-432c-49a4-a438-7c7c6e103070', 'dac955dd-c12a-4c48-8785-7d0acf8b701e', '256d79aa-dd72-4b0e-8d1b-864a6f93c6e5', 'c524256b-fd58-45fb-8def-fc359ebb72bc'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:07 devstack sudo[93699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:01:07 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:07 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.269s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:01:07 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Deleted volume successfully.
Sep 06 17:01:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-86fb7ef9-80b3-4aea-8dcc-41cdc602551c tempest-VolumesActionsTest-1095995201 None] Lock "cinder-a9548487-b447-4da1-95f7-3ef8d3643936-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (a8df44ec-d6a5-4b75-b54f-79062a7f3969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec7e7a4-a919-4b05-81c4-73af089b3ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec7e7a4-a919-4b05-81c4-73af089b3ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1733212656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d4387b-00b1-4851-a09f-d321b7e9acc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:08Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65aaecbd-9b76-4325-b5eb-020c69ffde89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65aaecbd-9b76-4325-b5eb-020c69ffde89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464c5cf4-095d-4d42-bf89-a594012c5d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464c5cf4-095d-4d42-bf89-a594012c5d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d4387b-00b1-4851-a09f-d321b7e9acc7', 'volume_name': 'volume-25d4387b-00b1-4851-a09f-d321b7e9acc7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca86bc9-bc27-4807-ad24-941cf06909be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca86bc9-bc27-4807-ad24-941cf06909be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee81ec2-0598-4071-a700-5782a8c5b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:08 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Volume 25d4387b-00b1-4851-a09f-d321b7e9acc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d4387b-00b1-4851-a09f-d321b7e9acc7', 'volume_size': 1}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1733212656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d4387b-00b1-4851-a09f-d321b7e9acc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:08Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Creating volume 25d4387b-00b1-4851-a09f-d321b7e9acc7 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:01:08 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:08 devstack sudo[93702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7 1073741824
Sep 06 17:01:08 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:08 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7 1073741824" returned: 0 in 0.415s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:08 devstack sudo[93707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7
Sep 06 17:01:08 devstack sudo[93707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:08 devstack sudo[93707]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7" returned: 0 in 0.231s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aee81ec2-0598-4071-a700-5782a8c5b48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d4387b-00b1-4851-a09f-d321b7e9acc7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828f6d6e-5917-4602-8f6d-01c4edf8abe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:08 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Volume volume-25d4387b-00b1-4851-a09f-d321b7e9acc7 (25d4387b-00b1-4851-a09f-d321b7e9acc7): created successfully
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828f6d6e-5917-4602-8f6d-01c4edf8abe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (a8df44ec-d6a5-4b75-b54f-79062a7f3969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:08 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c502fb0c-4189-4fa2-a48e-0b0caeb5c675 tempest-VolumesActionsTest-546496587 None] Created volume successfully.
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Acquiring lock "cinder-25d4387b-00b1-4851-a09f-d321b7e9acc7-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Lock "cinder-25d4387b-00b1-4851-a09f-d321b7e9acc7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Acquiring lock "cinder-quobyte-25d4387b-00b1-4851-a09f-d321b7e9acc7" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Lock "cinder-quobyte-25d4387b-00b1-4851-a09f-d321b7e9acc7" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ebc79b-5467-4f17-8cc1-48a2ce12f783]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:09 devstack sudo[93710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7
Sep 06 17:01:09 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:09 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7" returned: 0 in 0.355s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:09 devstack sudo[93715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7
Sep 06 17:01:09 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:09 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-25d4387b-00b1-4851-a09f-d321b7e9acc7" returned: 0 in 0.231s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Lock "cinder-quobyte-25d4387b-00b1-4851-a09f-d321b7e9acc7" released by "delete_volume" :: held 0.621s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:09 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Created reservations ['2083d80b-3e2c-420d-8b79-188b42fa9a71', 'acf30642-42d4-4c18-8b05-e68b2aea8742', '92d502f2-feae-494e-b9d2-0aacc456ed22', 'e5c6825e-b59e-4b9b-9a82-148266fe531c'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:10 devstack sudo[93718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:01:10 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:10 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.242s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:01:10 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Deleted volume successfully.
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b93ce4c-d24c-4890-8d5c-67342b1025c0 tempest-VolumesActionsTest-1095995201 None] Lock "cinder-25d4387b-00b1-4851-a09f-d321b7e9acc7-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:10 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (66d62a45-802a-4171-9d87-4e90792e5e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2296329-b5e9-46e4-b8e7-fac36162c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2296329-b5e9-46e4-b8e7-fac36162c1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-516923012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f2c738-6f2f-4ef1-8f87-76e1546ff77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:11Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345c00c7-a636-4ea2-abc2-b5737339a2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345c00c7-a636-4ea2-abc2-b5737339a2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08f184c-b828-4bcc-8cbb-c4fd817822c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08f184c-b828-4bcc-8cbb-c4fd817822c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f2c738-6f2f-4ef1-8f87-76e1546ff77f', 'volume_name': 'volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca3d36f-a086-4563-8353-b468d1c719c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca3d36f-a086-4563-8353-b468d1c719c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1beb82-2fe1-42e4-aeb5-4f535636fad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:11 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Volume 73f2c738-6f2f-4ef1-8f87-76e1546ff77f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f', 'volume_size': 1}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-516923012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f2c738-6f2f-4ef1-8f87-76e1546ff77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:11Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Creating volume 73f2c738-6f2f-4ef1-8f87-76e1546ff77f {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:01:11 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:11 devstack sudo[93722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f 1073741824
Sep 06 17:01:11 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:11 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f 1073741824" returned: 0 in 0.423s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:11 devstack sudo[93727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f
Sep 06 17:01:11 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:11 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f" returned: 0 in 0.237s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1beb82-2fe1-42e4-aeb5-4f535636fad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04179aef-3ad2-41cf-8bbe-51980b1d2e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:11 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Volume volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f (73f2c738-6f2f-4ef1-8f87-76e1546ff77f): created successfully
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04179aef-3ad2-41cf-8bbe-51980b1d2e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (66d62a45-802a-4171-9d87-4e90792e5e81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:11 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c634f22b-5e75-49c9-bd1a-741669d5118d tempest-VolumesActionsTest-546496587 None] Created volume successfully.
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Acquiring lock "cinder-73f2c738-6f2f-4ef1-8f87-76e1546ff77f-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Lock "cinder-73f2c738-6f2f-4ef1-8f87-76e1546ff77f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Acquiring lock "cinder-quobyte-73f2c738-6f2f-4ef1-8f87-76e1546ff77f" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Lock "cinder-quobyte-73f2c738-6f2f-4ef1-8f87-76e1546ff77f" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cf875a-a85f-4a7f-a5a7-fa6082a8fbfb]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:12 devstack sudo[93730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f
Sep 06 17:01:12 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:12 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f" returned: 0 in 0.362s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:12 devstack sudo[93735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f
Sep 06 17:01:12 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:12 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-73f2c738-6f2f-4ef1-8f87-76e1546ff77f" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Lock "cinder-quobyte-73f2c738-6f2f-4ef1-8f87-76e1546ff77f" released by "delete_volume" :: held 0.659s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:12 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Created reservations ['5a09ac6d-309f-4c77-88a3-2a4fe4b1d4fc', '9a365515-b5d8-4062-9780-d3643f621e13', '3e63e891-a7b7-4d56-83e5-deff00352ed3', '893ba7a8-d560-4987-b2c7-a322008d6540'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:13 devstack sudo[93738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:01:13 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:13 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.253s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:01:13 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Deleted volume successfully.
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94d230db-679c-424d-b4f9-6c7669b4d922 tempest-VolumesActionsTest-1095995201 None] Lock "cinder-73f2c738-6f2f-4ef1-8f87-76e1546ff77f-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (4e120756-60f9-4745-85d6-d85d7219e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536c9fb2-473c-45a6-bc51-f20e66ccadb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (536c9fb2-473c-45a6-bc51-f20e66ccadb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202494829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89991f33-934c-4158-9439-69ce808a65f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:14Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a152cec-eeaf-420d-94ab-db5a47c4475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a152cec-eeaf-420d-94ab-db5a47c4475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e36365-68df-4843-83cf-2759a7aa7fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e36365-68df-4843-83cf-2759a7aa7fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89991f33-934c-4158-9439-69ce808a65f7', 'volume_name': 'volume-89991f33-934c-4158-9439-69ce808a65f7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cd66b7-28ab-4d80-b7fe-0b2382267754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cd66b7-28ab-4d80-b7fe-0b2382267754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52380fad-4989-4206-800e-e563193f6084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:13 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Volume 89991f33-934c-4158-9439-69ce808a65f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89991f33-934c-4158-9439-69ce808a65f7', 'volume_size': 1}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-202494829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89991f33-934c-4158-9439-69ce808a65f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ca43059f77443b6a9de0c7a201d0058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:14Z,use_quota=True,user_id='fcd12abe4e384c42b4025d00716cc1b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Creating volume 89991f33-934c-4158-9439-69ce808a65f7 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:01:13 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:01:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:13 devstack sudo[93741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7 1073741824
Sep 06 17:01:13 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:14 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7 1073741824" returned: 0 in 0.421s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:14 devstack sudo[93749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7
Sep 06 17:01:14 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:14 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7" returned: 0 in 0.272s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:01:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52380fad-4989-4206-800e-e563193f6084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89991f33-934c-4158-9439-69ce808a65f7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4f6ab-b6a8-457a-8c27-1ced6fcde60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:14 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Volume volume-89991f33-934c-4158-9439-69ce808a65f7 (89991f33-934c-4158-9439-69ce808a65f7): created successfully
Sep 06 17:01:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4f6ab-b6a8-457a-8c27-1ced6fcde60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Flow 'volume_create_manager' (4e120756-60f9-4745-85d6-d85d7219e852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:14 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a90f1de0-8b67-4148-a251-6dc97d26460e tempest-VolumesActionsTest-546496587 None] Created volume successfully.
Sep 06 17:01:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Acquiring lock "cinder-89991f33-934c-4158-9439-69ce808a65f7-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Lock "cinder-89991f33-934c-4158-9439-69ce808a65f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Acquiring lock "cinder-quobyte-89991f33-934c-4158-9439-69ce808a65f7" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Lock "cinder-quobyte-89991f33-934c-4158-9439-69ce808a65f7" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:15 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[822785fa-6058-4f1d-a5b4-28b5b4deaed0]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:01:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:15 devstack sudo[93778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7
Sep 06 17:01:15 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:16 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7" returned: 0 in 0.430s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:16 devstack sudo[93784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7
Sep 06 17:01:16 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:16 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-89991f33-934c-4158-9439-69ce808a65f7" returned: 0 in 0.307s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Lock "cinder-quobyte-89991f33-934c-4158-9439-69ce808a65f7" released by "delete_volume" :: held 0.785s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Created reservations ['a0d12ca7-2b7c-40c2-b122-484c9195148a', '20212e4b-8590-4a2d-aa7c-99871f9823cb', '4a72e2ef-b838-4150-a5ef-c9aa00b43615', '854d8916-6821-4db2-a67f-8665a90f29ab'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:16 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:01:16 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-68f3a635-a62e-4438-8656-302068d94258 req-544abd64-3915-41ff-882d-ccfc1c31d12e tempest-ServerActionsTestOtherA-1388397706 None] Terminate volume connection completed successfully.
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-68f3a635-a62e-4438-8656-302068d94258 req-544abd64-3915-41ff-882d-ccfc1c31d12e tempest-ServerActionsTestOtherA-1388397706 None] Deleting attachment 44111a49-b622-4038-aa8d-bb236e5a1bd5. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:01:16 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:01:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "cinder-e5a82b16-6e15-4280-821e-1d8e03e139f8-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:17 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Deleted volume successfully.
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Lock "cinder-e5a82b16-6e15-4280-821e-1d8e03e139f8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-bbda3ad8-0a12-4643-955a-a730c6787387 tempest-VolumesActionsTest-546496587 None] Lock "cinder-89991f33-934c-4158-9439-69ce808a65f7-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "cinder-quobyte-e5a82b16-6e15-4280-821e-1d8e03e139f8" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Lock "cinder-quobyte-e5a82b16-6e15-4280-821e-1d8e03e139f8" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2615a3c7-8274-465c-8399-3cf471f0768b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:17 devstack sudo[93792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8
Sep 06 17:01:17 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:17 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8" returned: 0 in 0.427s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:17 devstack sudo[93803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8
Sep 06 17:01:17 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "cinder-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Lock "cinder-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "cinder-quobyte-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Lock "cinder-quobyte-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f3606f-fe1f-4cd4-91ad-380d72d4ed86]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:17 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e5a82b16-6e15-4280-821e-1d8e03e139f8" returned: 0 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Lock "cinder-quobyte-e5a82b16-6e15-4280-821e-1d8e03e139f8" released by "delete_volume" :: held 0.825s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:17 devstack cinder-volume[87474]: DEBUG cinder.quota [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Created reservations ['011e6ba5-df2a-47f5-834f-1ea43502f5f3', '5adcd679-0c29-4fb0-b1e6-754b7e430973', 'd99704c6-e03f-4b71-94be-7adf61214f47', '9f53dc2d-24a2-4836-82b4-927e5662c490'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:01:17 devstack sudo[93805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e
Sep 06 17:01:17 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:18 devstack sudo[93808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:01:18 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:18 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e" returned: 0 in 0.397s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:18 devstack sudo[93814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e
Sep 06 17:01:18 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:18 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.283s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.manager [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:01:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Deleted volume successfully.
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-68f3a635-a62e-4438-8656-302068d94258 req-a29bb726-ee35-412c-8e61-c254823d52bc tempest-ServerActionsTestOtherA-1388397706 None] Lock "cinder-e5a82b16-6e15-4280-821e-1d8e03e139f8-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:18 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e" returned: 0 in 0.290s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Lock "cinder-quobyte-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e" released by "delete_volume" :: held 0.726s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Created reservations ['d80861c7-b210-4828-9607-f155c5c1c876', 'b1cb68b1-304f-41ac-b95f-33398f681239', '68f13664-50fb-4791-a518-77a3acca46b8', 'f242dc52-4d11-40d4-9172-12079145eece'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:18 devstack sudo[93819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:01:18 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:18 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.268s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:01:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Deleted volume successfully.
Sep 06 17:01:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8b6aec2-2a32-4c24-80e5-b07f01db31a0 tempest-ServerActionsTestOtherA-1388397706 None] Lock "cinder-d783aaa3-dde7-4ca0-9d32-2b4b429cc17e-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-78c8164b-c1fc-4f7b-b1c3-c1b1830b77c6 req-82865452-41eb-4d40-bbf1-3d1d7bb61aa6 tempest-AttachVolumeTestJSON-1172774509 None] Terminate volume connection completed successfully.
Sep 06 17:01:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-78c8164b-c1fc-4f7b-b1c3-c1b1830b77c6 req-82865452-41eb-4d40-bbf1-3d1d7bb61aa6 tempest-AttachVolumeTestJSON-1172774509 None] Deleting attachment d962f0d3-ac6f-41df-aa2a-210c8d696f91. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:01:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:01:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:01:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:01:32 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=100,cinder:SELECT=59,cinder:DELETE=8,cinder:INSERT=20 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:01:32 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=65,cinder:INSERT=20,cinder:UPDATE=72,cinder:DELETE=6 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Flow 'volume_create_manager' (a07f5f0e-9133-490c-a48c-6adc72fa99e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00984f6-2cbb-48f9-bfe5-0cd05588bc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00984f6-2cbb-48f9-bfe5-0cd05588bc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1830985150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28665a6b-d029-43ea-9132-ec050a60f52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288bdf82df6345b7a7d47f5c2d1254ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:42Z,use_quota=True,user_id='d753f98ce92a431ea8a40b5344a04d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2b0dd6-b1ed-42f6-8a23-cfb69d5d1611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2b0dd6-b1ed-42f6-8a23-cfb69d5d1611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cbf7f6-420e-4530-b1b4-5041f83d92f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cbf7f6-420e-4530-b1b4-5041f83d92f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28665a6b-d029-43ea-9132-ec050a60f52b', 'volume_name': 'volume-28665a6b-d029-43ea-9132-ec050a60f52b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8d5a98-f3b3-4f38-ba6d-a52fafee58f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b8d5a98-f3b3-4f38-ba6d-a52fafee58f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdaa3fb-7169-4336-9754-f672d48e35c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:42 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Volume 28665a6b-d029-43ea-9132-ec050a60f52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28665a6b-d029-43ea-9132-ec050a60f52b', 'volume_size': 1}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1830985150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28665a6b-d029-43ea-9132-ec050a60f52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288bdf82df6345b7a7d47f5c2d1254ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:42Z,use_quota=True,user_id='d753f98ce92a431ea8a40b5344a04d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Creating volume 28665a6b-d029-43ea-9132-ec050a60f52b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:01:42 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:01:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:42 devstack sudo[93984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b 1073741824
Sep 06 17:01:42 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:43 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b 1073741824" returned: 0 in 0.580s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:43 devstack sudo[93990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b
Sep 06 17:01:43 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:43 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b" returned: 0 in 0.282s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:01:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fdaa3fb-7169-4336-9754-f672d48e35c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28665a6b-d029-43ea-9132-ec050a60f52b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b745b17d-25ca-49af-8005-693748f22711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:43 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Volume volume-28665a6b-d029-43ea-9132-ec050a60f52b (28665a6b-d029-43ea-9132-ec050a60f52b): created successfully
Sep 06 17:01:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b745b17d-25ca-49af-8005-693748f22711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Flow 'volume_create_manager' (a07f5f0e-9133-490c-a48c-6adc72fa99e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cd5ee5ec-7bcd-4291-9569-21ba07838e40 tempest-VolumesTransfersTest-1210544065 None] Created volume successfully.
Sep 06 17:01:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-af81d7c2-2885-4e21-95fc-0a9522495c90 tempest-VolumesTransfersTest-905782504 None] Transfer volume completed successfully.
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Acquiring lock "cinder-28665a6b-d029-43ea-9132-ec050a60f52b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Lock "cinder-28665a6b-d029-43ea-9132-ec050a60f52b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Acquiring lock "cinder-quobyte-28665a6b-d029-43ea-9132-ec050a60f52b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Lock "cinder-quobyte-28665a6b-d029-43ea-9132-ec050a60f52b" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[170a66bc-affa-4bfc-8ef1-65356e125387]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:46 devstack sudo[93998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b
Sep 06 17:01:46 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:46 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b" returned: 0 in 0.472s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:46 devstack sudo[94003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b
Sep 06 17:01:46 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:46 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-28665a6b-d029-43ea-9132-ec050a60f52b" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Lock "cinder-quobyte-28665a6b-d029-43ea-9132-ec050a60f52b" released by "delete_volume" :: held 0.794s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:46 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Created reservations ['7e96d4fe-c9e6-4286-81d7-36bff716fdb4', 'de9afd92-4995-4b5a-8e99-b3da0fd90474', '1a85ce22-bf4c-4c9c-bfc6-d665745a1fbf', '887bd981-8d41-41b5-9530-85b6a7f86af0'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:47 devstack sudo[94010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:01:47 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:47 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.345s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:01:47 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Deleted volume successfully.
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3e3b5954-53b4-4efc-8bc7-33b3f81c2620 tempest-VolumesTransfersTest-532682050 None] Lock "cinder-28665a6b-d029-43ea-9132-ec050a60f52b-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Flow 'volume_create_manager' (161ece3b-074a-4adc-b371-41db63397fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33297292-c5eb-4634-8277-fab5928ed03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33297292-c5eb-4634-8277-fab5928ed03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1359779619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288bdf82df6345b7a7d47f5c2d1254ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:48Z,use_quota=True,user_id='d753f98ce92a431ea8a40b5344a04d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b4970c-d29f-4b8e-93e0-007609dcf776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b4970c-d29f-4b8e-93e0-007609dcf776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaa0e5f-9c14-42c7-a41a-567842a47b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaa0e5f-9c14-42c7-a41a-567842a47b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72', 'volume_name': 'volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e35782-6e1c-4837-b853-379e43e5ffdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e35782-6e1c-4837-b853-379e43e5ffdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac99f4da-55cd-4866-a269-92ff76d3d592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:48 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Volume 5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72', 'volume_size': 1}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1359779619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288bdf82df6345b7a7d47f5c2d1254ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:01:48Z,use_quota=True,user_id='d753f98ce92a431ea8a40b5344a04d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Creating volume 5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:01:48 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:48 devstack sudo[94030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72 1073741824
Sep 06 17:01:48 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:48 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72 1073741824" returned: 0 in 0.419s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:48 devstack sudo[94035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72
Sep 06 17:01:48 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:48 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72" returned: 0 in 0.296s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac99f4da-55cd-4866-a269-92ff76d3d592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a63fb0-16ee-4eb1-a6e5-38995ca560fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:01:48 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Volume volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72 (5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72): created successfully
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a63fb0-16ee-4eb1-a6e5-38995ca560fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:01:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Flow 'volume_create_manager' (161ece3b-074a-4adc-b371-41db63397fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:01:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6c4bcd0d-a3eb-4965-b36e-22225b82c1bf tempest-VolumesTransfersTest-1210544065 None] Created volume successfully.
Sep 06 17:01:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Acquiring lock "cinder-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Lock "cinder-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Acquiring lock "cinder-quobyte-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:01:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Lock "cinder-quobyte-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72" acquired by "delete_volume" :: waited 0.045s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:01:49 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cbab10-5346-4e63-bf0e-8e6f7be77064]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:01:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:49 devstack sudo[94075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72
Sep 06 17:01:49 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:50 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72" returned: 0 in 0.774s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:50 devstack sudo[94108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72
Sep 06 17:01:50 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:50 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72" returned: 0 in 0.297s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Lock "cinder-quobyte-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72" released by "delete_volume" :: held 1.152s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Created reservations ['9917ef83-a553-4abd-b4c7-83e11f307901', '7e63384a-c4d4-4584-b58c-3656e072e2f5', 'bb8cf922-59a3-41f5-a528-6d7ad923b9d3', '245d398d-40ef-4eca-a4ef-9d583b8cb8fc'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:01:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:01:50 devstack sudo[94114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:01:50 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:01:51 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root
Sep 06 17:01:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.316s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:01:51 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:01:51 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Deleted volume successfully.
Sep 06 17:01:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1d24d83e-5824-4505-939f-421acc4ed0b9 tempest-VolumesTransfersTest-532682050 None] Lock "cinder-5ff484c8-b0ac-4bf5-8ce2-0f4eb50f3a72-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:00 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=16,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:02:01 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=13,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Flow 'volume_create_manager' (dd19b317-f0b5-440f-870d-881f71099821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2d4609-507e-4a28-a132-3180e6b896d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2d4609-507e-4a28-a132-3180e6b896d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1397818901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbff90d-0b54-466c-956b-eae0d9843695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b227ab25cd41e7b24e8c52405d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:06Z,use_quota=True,user_id='245e91d2c50542c581c1adf7c8173df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea66d4ae-089f-448a-b4ca-b89695aa6e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea66d4ae-089f-448a-b4ca-b89695aa6e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7f71ac-84d9-4d96-b155-15e951b1a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7f71ac-84d9-4d96-b155-15e951b1a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cbff90d-0b54-466c-956b-eae0d9843695', 'volume_name': 'volume-0cbff90d-0b54-466c-956b-eae0d9843695', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5b0336-6591-48a9-9d24-cff0081433a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5b0336-6591-48a9-9d24-cff0081433a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7649d71f-dbfa-412c-919e-c986a277a5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:06 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Volume 0cbff90d-0b54-466c-956b-eae0d9843695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cbff90d-0b54-466c-956b-eae0d9843695', 'volume_size': 1}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1397818901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cbff90d-0b54-466c-956b-eae0d9843695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b227ab25cd41e7b24e8c52405d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:06Z,use_quota=True,user_id='245e91d2c50542c581c1adf7c8173df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Creating volume 0cbff90d-0b54-466c-956b-eae0d9843695 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:06 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:06 devstack sudo[94306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695 1073741824
Sep 06 17:02:06 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:07 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695 1073741824" returned: 0 in 0.694s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:07 devstack sudo[94318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695
Sep 06 17:02:07 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:07 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695" returned: 0 in 0.294s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7649d71f-dbfa-412c-919e-c986a277a5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cbff90d-0b54-466c-956b-eae0d9843695', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63697176-5ab7-4b8e-8138-cc73b2603976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:07 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Volume volume-0cbff90d-0b54-466c-956b-eae0d9843695 (0cbff90d-0b54-466c-956b-eae0d9843695): created successfully
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63697176-5ab7-4b8e-8138-cc73b2603976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Flow 'volume_create_manager' (dd19b317-f0b5-440f-870d-881f71099821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:07 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ba5a3806-038b-4317-a127-19462690544e tempest-VolumesTransfersV357Test-1241206718 None] Created volume successfully.
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Flow 'volume_create_manager' (a7772dfb-32be-422c-af9b-b128eafd4239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d3450b-6aba-445a-a64b-3268f9d9662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d3450b-6aba-445a-a64b-3268f9d9662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-314159615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d759104-de96-4cff-806b-2820d9a6aab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3829b986fec44db084ecbd025286e3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:08Z,use_quota=True,user_id='529f9f12d36149e291eef8926bd817c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b05058a-f846-4bb5-8453-399a4056473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b05058a-f846-4bb5-8453-399a4056473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407d56d9-c652-4ecf-9f51-c1a7494c3cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407d56d9-c652-4ecf-9f51-c1a7494c3cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d759104-de96-4cff-806b-2820d9a6aab5', 'volume_name': 'volume-6d759104-de96-4cff-806b-2820d9a6aab5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f51826-2f54-40bf-b407-ea89cda98efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f51826-2f54-40bf-b407-ea89cda98efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af93886-50c4-4535-b1cf-7ee0b31c82ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:07 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Volume 6d759104-de96-4cff-806b-2820d9a6aab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d759104-de96-4cff-806b-2820d9a6aab5', 'volume_size': 1}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-314159615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d759104-de96-4cff-806b-2820d9a6aab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3829b986fec44db084ecbd025286e3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:08Z,use_quota=True,user_id='529f9f12d36149e291eef8926bd817c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Creating volume 6d759104-de96-4cff-806b-2820d9a6aab5 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:07 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:07 devstack sudo[94321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5 1073741824
Sep 06 17:02:07 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:08 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5 1073741824" returned: 0 in 0.465s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:08 devstack sudo[94328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5
Sep 06 17:02:08 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:08 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5" returned: 0 in 0.279s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af93886-50c4-4535-b1cf-7ee0b31c82ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d759104-de96-4cff-806b-2820d9a6aab5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a654425-ee86-454a-bf01-c2f520859cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:08 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Volume volume-6d759104-de96-4cff-806b-2820d9a6aab5 (6d759104-de96-4cff-806b-2820d9a6aab5): created successfully
Sep 06 17:02:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a654425-ee86-454a-bf01-c2f520859cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Flow 'volume_create_manager' (a7772dfb-32be-422c-af9b-b128eafd4239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:08 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-433ca30a-bc92-428b-9adc-e60ad4a3d8ca tempest-ServersNegativeTestJSON-725847547 None] Created volume successfully.
Sep 06 17:02:09 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-fb4343aa-da80-451d-b5e7-87055281b4f8 tempest-VolumesTransfersV357Test-914385736 None] Transfer volume completed successfully.
Sep 06 17:02:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Acquiring lock "cinder-0cbff90d-0b54-466c-956b-eae0d9843695-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Lock "cinder-0cbff90d-0b54-466c-956b-eae0d9843695-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Acquiring lock "cinder-quobyte-0cbff90d-0b54-466c-956b-eae0d9843695" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Lock "cinder-quobyte-0cbff90d-0b54-466c-956b-eae0d9843695" acquired by "delete_volume" :: waited 0.031s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:10 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e196b272-a734-407f-aa3f-851ee3428c0a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:11 devstack sudo[94399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695
Sep 06 17:02:11 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:11 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695" returned: 0 in 0.610s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:11 devstack sudo[94405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695
Sep 06 17:02:11 devstack sudo[94405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:11 devstack sudo[94405]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0cbff90d-0b54-466c-956b-eae0d9843695" returned: 0 in 0.342s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Lock "cinder-quobyte-0cbff90d-0b54-466c-956b-eae0d9843695" released by "delete_volume" :: held 1.046s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Created reservations ['e0735451-062a-4d95-bb1f-ace1096948a8', '4e6f951b-b358-4d2c-a162-d255f1a37543', '019446cc-761e-459d-89f0-8ed648628601', '2676b6bb-dca2-49bd-a6e1-9bcb0ced88bf'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:11 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:11 devstack sudo[94408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Flow 'volume_create_manager' (cb7b6527-cfd2-4957-9ca0-2bf96531143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:11 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2875b469-817e-41db-b0fc-df9ea8af8f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2875b469-817e-41db-b0fc-df9ea8af8f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1625030504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767ae7d9-660a-4ea6-995c-881390bd7663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3829b986fec44db084ecbd025286e3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:12Z,use_quota=True,user_id='529f9f12d36149e291eef8926bd817c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448e0010-62d9-4cbd-ab4e-b1872f7e500d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448e0010-62d9-4cbd-ab4e-b1872f7e500d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7bb9fb-8a41-4e87-b5f4-f8f54fb70194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb7bb9fb-8a41-4e87-b5f4-f8f54fb70194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767ae7d9-660a-4ea6-995c-881390bd7663', 'volume_name': 'volume-767ae7d9-660a-4ea6-995c-881390bd7663', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de137f84-b61f-458f-b3c1-a5c25bcb48b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de137f84-b61f-458f-b3c1-a5c25bcb48b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3d2d7d-2555-4eb3-91c2-0419b25dc8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:12 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Volume 767ae7d9-660a-4ea6-995c-881390bd7663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767ae7d9-660a-4ea6-995c-881390bd7663', 'volume_size': 1}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1625030504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767ae7d9-660a-4ea6-995c-881390bd7663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3829b986fec44db084ecbd025286e3c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:12Z,use_quota=True,user_id='529f9f12d36149e291eef8926bd817c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Creating volume 767ae7d9-660a-4ea6-995c-881390bd7663 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:12 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:12 devstack sudo[94410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663 1073741824
Sep 06 17:02:12 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:12 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.428s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Deleted volume successfully.
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-79e3cd11-2f6e-42da-9a03-660904093f09 tempest-VolumesTransfersV357Test-929891438 None] Lock "cinder-0cbff90d-0b54-466c-956b-eae0d9843695-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:12 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663 1073741824" returned: 0 in 0.742s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:13 devstack sudo[94416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663
Sep 06 17:02:13 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:13 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663" returned: 0 in 0.415s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3d2d7d-2555-4eb3-91c2-0419b25dc8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767ae7d9-660a-4ea6-995c-881390bd7663', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6d977e-fd86-42f6-8fa2-85b7c610a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:13 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Volume volume-767ae7d9-660a-4ea6-995c-881390bd7663 (767ae7d9-660a-4ea6-995c-881390bd7663): created successfully
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6d977e-fd86-42f6-8fa2-85b7c610a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Flow 'volume_create_manager' (cb7b6527-cfd2-4957-9ca0-2bf96531143b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:13 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-49186c60-4d33-441b-bbac-d753058dfce6 tempest-ServersNegativeTestJSON-725847547 None] Created volume successfully.
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Flow 'volume_create_manager' (b7396c0c-14b7-4fef-8498-cd8c59850535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a9168e-176f-49e0-9a49-a91d6100fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a9168e-176f-49e0-9a49-a91d6100fda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1201980709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a18e20-97f9-4cba-89a5-f4403b581802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b227ab25cd41e7b24e8c52405d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:14Z,use_quota=True,user_id='245e91d2c50542c581c1adf7c8173df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7337002b-b68f-4f47-ae50-4d23ef4aa49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7337002b-b68f-4f47-ae50-4d23ef4aa49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30050d52-0b8b-40f6-9f7c-7be2ea1a8cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30050d52-0b8b-40f6-9f7c-7be2ea1a8cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a18e20-97f9-4cba-89a5-f4403b581802', 'volume_name': 'volume-c8a18e20-97f9-4cba-89a5-f4403b581802', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9da45f-3f68-4c4a-9bf3-c897adb1ee88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9da45f-3f68-4c4a-9bf3-c897adb1ee88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0c5366-8371-4040-b217-d6c70f98f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:13 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Volume c8a18e20-97f9-4cba-89a5-f4403b581802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a18e20-97f9-4cba-89a5-f4403b581802', 'volume_size': 1}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1201980709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a18e20-97f9-4cba-89a5-f4403b581802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b227ab25cd41e7b24e8c52405d16b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:14Z,use_quota=True,user_id='245e91d2c50542c581c1adf7c8173df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Creating volume c8a18e20-97f9-4cba-89a5-f4403b581802 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:13 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:13 devstack sudo[94420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802 1073741824
Sep 06 17:02:13 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:14 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802 1073741824" returned: 0 in 0.554s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "cinder-767ae7d9-660a-4ea6-995c-881390bd7663-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:14 devstack sudo[94427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802
Sep 06 17:02:14 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Lock "cinder-767ae7d9-660a-4ea6-995c-881390bd7663-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "cinder-quobyte-767ae7d9-660a-4ea6-995c-881390bd7663" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Lock "cinder-quobyte-767ae7d9-660a-4ea6-995c-881390bd7663" acquired by "delete_volume" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c843c-dae4-40c6-94a1-dc4ba63ef4cb]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:14 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:14 devstack sudo[94429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802" returned: 0 in 0.343s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:14 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a0c5366-8371-4040-b217-d6c70f98f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a18e20-97f9-4cba-89a5-f4403b581802', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254b4fcf-dda8-4c19-b4f1-96940f7a5406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:14 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Volume volume-c8a18e20-97f9-4cba-89a5-f4403b581802 (c8a18e20-97f9-4cba-89a5-f4403b581802): created successfully
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254b4fcf-dda8-4c19-b4f1-96940f7a5406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Flow 'volume_create_manager' (b7396c0c-14b7-4fef-8498-cd8c59850535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:14 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-dbff9774-87ab-416f-ae95-17b90dfeefec tempest-VolumesTransfersV357Test-1241206718 None] Created volume successfully.
Sep 06 17:02:15 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663" returned: 0 in 0.421s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:15 devstack sudo[94435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663
Sep 06 17:02:15 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:15 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-767ae7d9-660a-4ea6-995c-881390bd7663" returned: 0 in 0.250s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Lock "cinder-quobyte-767ae7d9-660a-4ea6-995c-881390bd7663" released by "delete_volume" :: held 0.748s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Created reservations ['8b699e46-f129-4c89-8bb8-ac4193e3b1a5', 'e6bb9f40-329a-4390-972a-d3671bbb2beb', 'fd933534-4728-43ba-b43d-29d5e040c073', '3ede60c2-5265-4dd5-92b7-70eb730686c3'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:15 devstack sudo[94438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:15 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "cinder-6d759104-de96-4cff-806b-2820d9a6aab5-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Lock "cinder-6d759104-de96-4cff-806b-2820d9a6aab5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "cinder-quobyte-6d759104-de96-4cff-806b-2820d9a6aab5" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:15 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.282s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Deleted volume successfully.
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Lock "cinder-quobyte-6d759104-de96-4cff-806b-2820d9a6aab5" acquired by "delete_volume" :: waited 0.039s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a304b871-7617-40e4-9950-34ad3eaf05ad tempest-ServersNegativeTestJSON-725847547 None] Lock "cinder-767ae7d9-660a-4ea6-995c-881390bd7663-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d21f66-9b69-4741-ab19-8a820960ebfa]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:15 devstack sudo[94441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5
Sep 06 17:02:15 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Acquiring lock "cinder-c8a18e20-97f9-4cba-89a5-f4403b581802-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:16 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5" returned: 0 in 0.407s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Lock "cinder-c8a18e20-97f9-4cba-89a5-f4403b581802-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:16 devstack sudo[94446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5
Sep 06 17:02:16 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Acquiring lock "cinder-quobyte-c8a18e20-97f9-4cba-89a5-f4403b581802" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Lock "cinder-quobyte-c8a18e20-97f9-4cba-89a5-f4403b581802" acquired by "delete_volume" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3060cb8a-f70c-480f-bcca-11348789d479]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:16 devstack sudo[94448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802
Sep 06 17:02:16 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:16 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6d759104-de96-4cff-806b-2820d9a6aab5" returned: 0 in 0.268s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Lock "cinder-quobyte-6d759104-de96-4cff-806b-2820d9a6aab5" released by "delete_volume" :: held 0.742s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Created reservations ['03c5f1ff-a1e9-4956-80d5-f616e1e893d9', '375fbfd9-ec14-4d87-93d2-b1a3f51a90c0', 'fc0b980b-d0c7-4ab3-a448-4e630e6a4fb6', '464d81ea-15a6-4c90-9253-12c078c38706'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:16 devstack sudo[94451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:16 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:16 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802" returned: 0 in 0.425s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:16 devstack sudo[94456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802
Sep 06 17:02:16 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:16 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.265s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Deleted volume successfully.
Sep 06 17:02:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3d77c49d-8927-4385-ae1b-475049f6b219 tempest-ServersNegativeTestJSON-725847547 None] Lock "cinder-6d759104-de96-4cff-806b-2820d9a6aab5-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:17 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c8a18e20-97f9-4cba-89a5-f4403b581802" returned: 0 in 0.329s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Lock "cinder-quobyte-c8a18e20-97f9-4cba-89a5-f4403b581802" released by "delete_volume" :: held 0.810s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Created reservations ['2fc3133b-49dc-4d5c-83fa-91a00814227c', '988332de-b1d8-4b77-8275-709a46029694', '071b69cb-3130-43bf-9ad6-102be075c748', '6239333f-327b-4678-aa7b-a42cb49d1656'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:17 devstack sudo[94461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:17 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:17 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.619s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:17 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Deleted volume successfully.
Sep 06 17:02:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-805e7152-480a-4bf1-b8ac-190fda5bce5e tempest-VolumesTransfersV357Test-929891438 None] Lock "cinder-c8a18e20-97f9-4cba-89a5-f4403b581802-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (ded68617-2ff3-48f7-b183-240a1e6299ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29ed751-4241-486b-8f17-50f9eb515288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29ed751-4241-486b-8f17-50f9eb515288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141640964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c1a2cd-1edd-42c0-a553-d98462a46afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:25Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea331e2-936d-47e9-8780-bdfd5dea38ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea331e2-936d-47e9-8780-bdfd5dea38ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61f9f51-098c-4662-bc8b-46aa84ca2814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d61f9f51-098c-4662-bc8b-46aa84ca2814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c1a2cd-1edd-42c0-a553-d98462a46afa', 'volume_name': 'volume-79c1a2cd-1edd-42c0-a553-d98462a46afa', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd6088c-9e95-4ac9-b990-5c336e932249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd6088c-9e95-4ac9-b990-5c336e932249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa44e108-9cd6-463a-84a2-818d07185f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:25 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume 79c1a2cd-1edd-42c0-a553-d98462a46afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c1a2cd-1edd-42c0-a553-d98462a46afa', 'volume_size': 1}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141640964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c1a2cd-1edd-42c0-a553-d98462a46afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:25Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Creating volume 79c1a2cd-1edd-42c0-a553-d98462a46afa {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:25 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:25 devstack sudo[94527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa 1073741824
Sep 06 17:02:25 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:25 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa 1073741824" returned: 0 in 0.505s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:25 devstack sudo[94534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa
Sep 06 17:02:25 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:25 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa" returned: 0 in 0.262s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa44e108-9cd6-463a-84a2-818d07185f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c1a2cd-1edd-42c0-a553-d98462a46afa', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aecd81d-283b-4817-b36b-4e937637906b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:26 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume volume-79c1a2cd-1edd-42c0-a553-d98462a46afa (79c1a2cd-1edd-42c0-a553-d98462a46afa): created successfully
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aecd81d-283b-4817-b36b-4e937637906b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (ded68617-2ff3-48f7-b183-240a1e6299ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:26 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-17ba80f3-165e-41de-89a1-fcaa9a84672f tempest-CreateVolumesFromSnapshotTest-774690854 None] Created volume successfully.
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:26 devstack sudo[94537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:26 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:26 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.248s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:02:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:02:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Creating offline snapshot 94080d81-dfac-4671-8218-2549977b8713 of volume 79c1a2cd-1edd-42c0-a553-d98462a46afa {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:02:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4357e6dd-824f-4541-9812-27ad246c2442]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:27 devstack sudo[94542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa
Sep 06 17:02:27 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:27 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa" returned: 0 in 0.375s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:27 devstack sudo[94547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 1G
Sep 06 17:02:27 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:28 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 1G" returned: 0 in 0.428s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c1a2cd-1edd-42c0-a553-d98462a46afa -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:28 devstack sudo[94553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c1a2cd-1edd-42c0-a553-d98462a46afa -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713
Sep 06 17:02:28 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:28 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c1a2cd-1edd-42c0-a553-d98462a46afa -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713" returned: 0 in 0.303s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:28 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 is being set with open permissions: ugo+rw
Sep 06 17:02:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:28 devstack sudo[94559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713
Sep 06 17:02:28 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:28 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713" returned: 0 in 0.283s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:28 devstack sudo[94562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.info
Sep 06 17:02:28 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:29 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.info" returned: 0 in 0.283s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:29 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.info is being set with open permissions: ugo+rw
Sep 06 17:02:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:29 devstack sudo[94565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.info
Sep 06 17:02:29 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:29 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.info" returned: 0 in 0.270s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:29 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-2fbf1792-a33b-468a-8184-44da5c9c20eb tempest-CreateVolumesFromSnapshotTest-774690854 None] Create snapshot completed successfully
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (e5e33a1d-4516-4658-96e4-a64797ca6179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c76ee1a-a33d-469c-9535-199755ba7270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c76ee1a-a33d-469c-9535-199755ba7270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291438532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812c7df6-0ae5-4990-a4ee-2a3d230c73b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:31Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3464e284-eb9c-49dd-9b4f-a5028d694ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3464e284-eb9c-49dd-9b4f-a5028d694ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de4bd50-f83b-4f9a-9713-65c1adbb2b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de4bd50-f83b-4f9a-9713-65c1adbb2b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '812c7df6-0ae5-4990-a4ee-2a3d230c73b7', 'volume_name': 'volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f3f44e-02f0-437e-9063-44497642783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f3f44e-02f0-437e-9063-44497642783b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a417f8-e816-49d1-9036-8b3f0eebe453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume 812c7df6-0ae5-4990-a4ee-2a3d230c73b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7', 'volume_size': 1}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291438532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=812c7df6-0ae5-4990-a4ee-2a3d230c73b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:31Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Creating volume 812c7df6-0ae5-4990-a4ee-2a3d230c73b7 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:31 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:31 devstack sudo[94569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7 1073741824
Sep 06 17:02:31 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (2e07f1a7-2b9a-4410-96a7-da0bc66ddc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d348f2e7-40ad-4410-9672-ebae929891ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d348f2e7-40ad-4410-9672-ebae929891ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-19495341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7aa0a7-081f-446f-bd79-bb36e1f30195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:31Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687beeef-433d-4672-a0de-2134f1eb7b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687beeef-433d-4672-a0de-2134f1eb7b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a892b29-0f44-41c4-a28c-c61e94758ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a892b29-0f44-41c4-a28c-c61e94758ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7aa0a7-081f-446f-bd79-bb36e1f30195', 'volume_name': 'volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306e5ea0-03ef-4d21-97d7-a5c8e5e84808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306e5ea0-03ef-4d21-97d7-a5c8e5e84808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591e11a7-869a-4f87-a68f-56621bae411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:31 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume 3d7aa0a7-081f-446f-bd79-bb36e1f30195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195', 'volume_size': 1}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:31 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7 1073741824" returned: 0 in 0.550s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:31 devstack sudo[94576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7
Sep 06 17:02:31 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:32 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (a3ca5fd2-7788-40d4-8610-069fa1f18e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc734af-1144-46a3-a964-709c2199da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-19495341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7aa0a7-081f-446f-bd79-bb36e1f30195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:31Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Creating volume 3d7aa0a7-081f-446f-bd79-bb36e1f30195 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:32 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc734af-1144-46a3-a964-709c2199da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106433074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ab6864-c90c-4b91-a58c-adf1a4fa0aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:32Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f755d5-fcf6-4ca2-b703-291f95efb849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f755d5-fcf6-4ca2-b703-291f95efb849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21357076-be4e-483b-9bc3-fa716bf605ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack sudo[94579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195 1073741824
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21357076-be4e-483b-9bc3-fa716bf605ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ab6864-c90c-4b91-a58c-adf1a4fa0aa4', 'volume_name': 'volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack sudo[94579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac2d0da-1206-42b6-8140-f133c72b596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac2d0da-1206-42b6-8140-f133c72b596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1cff48-56f4-42f5-9fc5-e3dd4b13c765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume 71ab6864-c90c-4b91-a58c-adf1a4fa0aa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4', 'volume_size': 1}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a417f8-e816-49d1-9036-8b3f0eebe453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da1c3eb-2abf-4d11-86b9-2dc086bc54f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7 (812c7df6-0ae5-4990-a4ee-2a3d230c73b7): created successfully
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da1c3eb-2abf-4d11-86b9-2dc086bc54f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (e5e33a1d-4516-4658-96e4-a64797ca6179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:32 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-88232dd6-aeb1-48de-92d5-f7805e2b5721 tempest-CreateVolumesFromSnapshotTest-774690854 None] Created volume successfully.
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (e71ba861-cd50-428c-a4e0-e45963a1bcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2633139d-25a9-4d9b-8ae2-082c77ecf1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2633139d-25a9-4d9b-8ae2-082c77ecf1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-205848777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b157265e-0f3a-4752-8305-dfaa9021ab1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:32Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45992ae1-9e24-4065-b8a3-5515931a28e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45992ae1-9e24-4065-b8a3-5515931a28e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa5efa2-ca76-4eba-ae4c-b5f8865fa935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa5efa2-ca76-4eba-ae4c-b5f8865fa935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b157265e-0f3a-4752-8305-dfaa9021ab1d', 'volume_name': 'volume-b157265e-0f3a-4752-8305-dfaa9021ab1d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ea0e09-a6ed-45e4-a960-cce69f66258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ea0e09-a6ed-45e4-a960-cce69f66258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a0413e-c11a-4890-90cd-ca109129c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume b157265e-0f3a-4752-8305-dfaa9021ab1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b157265e-0f3a-4752-8305-dfaa9021ab1d', 'volume_size': 1}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:32 devstack sudo[94579]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195 1073741824" returned: 0 in 0.585s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:32 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195
Sep 06 17:02:32 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (e334cb7e-96c3-4f75-b6aa-905a87b30914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b81d21-36ee-42cb-9f1e-632e4014b6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b81d21-36ee-42cb-9f1e-632e4014b6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-59155993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d09a8bd-63b6-4ba6-81f3-37fca6532cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:33Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f00597-75d2-41aa-992e-94d20f5ba67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f00597-75d2-41aa-992e-94d20f5ba67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3ba047-09dd-4dd8-8280-12a4adffbb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d3ba047-09dd-4dd8-8280-12a4adffbb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d09a8bd-63b6-4ba6-81f3-37fca6532cd1', 'volume_name': 'volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59ee62e-351e-42e3-8e84-a7bfa1b9e80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59ee62e-351e-42e3-8e84-a7bfa1b9e80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997488ea-bda4-49b5-a523-92ed4cd5d7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume 1d09a8bd-63b6-4ba6-81f3-37fca6532cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1', 'volume_size': 1}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195" returned: 0 in 0.281s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106433074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ab6864-c90c-4b91-a58c-adf1a4fa0aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:32Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Creating volume 71ab6864-c90c-4b91-a58c-adf1a4fa0aa4 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:33 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591e11a7-869a-4f87-a68f-56621bae411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f7f21b-7c75-431a-94e4-b8f9625aa8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:33 devstack sudo[94588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4 1073741824
Sep 06 17:02:33 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:33 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195 (3d7aa0a7-081f-446f-bd79-bb36e1f30195): created successfully
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f7f21b-7c75-431a-94e4-b8f9625aa8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (2e07f1a7-2b9a-4410-96a7-da0bc66ddc28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0c1ee055-83c5-4bc0-a757-db4b16e376da tempest-CreateVolumesFromSnapshotTest-774690854 None] Created volume successfully.
Sep 06 17:02:33 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4 1073741824" returned: 0 in 0.434s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:33 devstack sudo[94594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4
Sep 06 17:02:33 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:33 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4" returned: 0 in 0.285s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-205848777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b157265e-0f3a-4752-8305-dfaa9021ab1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:32Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Creating volume b157265e-0f3a-4752-8305-dfaa9021ab1d {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:33 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cae038fd-534f-4293-ac91-7d723439d0fe tempest-GroupSnapshotsV319Test-1221526725 None] Group tempest-GroupSnapshotsV319Test-Group-1299874974: creating
Sep 06 17:02:33 devstack sudo[94599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d 1073741824
Sep 06 17:02:33 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a1cff48-56f4-42f5-9fc5-e3dd4b13c765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b61a165-885a-4c15-8618-0c4e80da7104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:33 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4 (71ab6864-c90c-4b91-a58c-adf1a4fa0aa4): created successfully
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b61a165-885a-4c15-8618-0c4e80da7104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (a3ca5fd2-7788-40d4-8610-069fa1f18e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6510fdf7-29b6-4933-8b11-07115bb2131b tempest-CreateVolumesFromSnapshotTest-774690854 None] Created volume successfully.
Sep 06 17:02:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cae038fd-534f-4293-ac91-7d723439d0fe tempest-GroupSnapshotsV319Test-1221526725 None] Group tempest-GroupSnapshotsV319Test-Group-1299874974: created successfully
Sep 06 17:02:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cae038fd-534f-4293-ac91-7d723439d0fe tempest-GroupSnapshotsV319Test-1221526725 None] Create group completed successfully.
Sep 06 17:02:34 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d 1073741824" returned: 0 in 0.527s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:34 devstack sudo[94605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d
Sep 06 17:02:34 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Flow 'volume_create_manager' (0e096731-e466-491b-befa-a494a3d12ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52f3435-51fe-4865-a99c-32d089e832d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52f3435-51fe-4865-a99c-32d089e832d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1059512453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ab1436-9b31-47d9-b267-15d7d742ee94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b421adef30ab484f9ab3c94acb66ea17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:34Z,use_quota=True,user_id='bf445686762c4711b6b22265e2160b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bdd53d-e6be-4211-bbaf-06ee52942455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9bdd53d-e6be-4211-bbaf-06ee52942455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ab46ea-d4dc-441e-b42f-eb2c772eecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ab46ea-d4dc-441e-b42f-eb2c772eecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ab1436-9b31-47d9-b267-15d7d742ee94', 'volume_name': 'volume-31ab1436-9b31-47d9-b267-15d7d742ee94', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6c107f-0079-437e-b3c5-8bc8c272d5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6c107f-0079-437e-b3c5-8bc8c272d5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab3787b-72a1-488b-8072-7865ed48cfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Volume 31ab1436-9b31-47d9-b267-15d7d742ee94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ab1436-9b31-47d9-b267-15d7d742ee94', 'volume_size': 1}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:34 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d" returned: 0 in 0.241s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-59155993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d09a8bd-63b6-4ba6-81f3-37fca6532cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='406f222bc944488cb036596260d13dd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:33Z,use_quota=True,user_id='880bc364571640c5b0aa5f16632c6d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Creating volume 1d09a8bd-63b6-4ba6-81f3-37fca6532cd1 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:34 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:34 devstack sudo[94608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1 1073741824
Sep 06 17:02:34 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a0413e-c11a-4890-90cd-ca109129c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b157265e-0f3a-4752-8305-dfaa9021ab1d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de0676b-ecec-484f-b40e-d25f01f17082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume volume-b157265e-0f3a-4752-8305-dfaa9021ab1d (b157265e-0f3a-4752-8305-dfaa9021ab1d): created successfully
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de0676b-ecec-484f-b40e-d25f01f17082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (e71ba861-cd50-428c-a4e0-e45963a1bcf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c64aa0a4-a0e0-4fb3-bfba-a9ff6f135051 tempest-CreateVolumesFromSnapshotTest-774690854 None] Created volume successfully.
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1 1073741824" returned: 0 in 0.421s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:35 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:35 devstack sudo[94614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1
Sep 06 17:02:35 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:35 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1" returned: 0 in 0.298s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1059512453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ab1436-9b31-47d9-b267-15d7d742ee94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b421adef30ab484f9ab3c94acb66ea17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:34Z,use_quota=True,user_id='bf445686762c4711b6b22265e2160b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Creating volume 31ab1436-9b31-47d9-b267-15d7d742ee94 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:35 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997488ea-bda4-49b5-a523-92ed4cd5d7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:35 devstack sudo[94617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94 1073741824
Sep 06 17:02:35 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f040baf4-35b7-4153-9da9-4013b242c708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Volume volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1 (1d09a8bd-63b6-4ba6-81f3-37fca6532cd1): created successfully
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f040baf4-35b7-4153-9da9-4013b242c708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Flow 'volume_create_manager' (e334cb7e-96c3-4f75-b6aa-905a87b30914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3eee9a1c-dc40-4325-bea0-b719019ccbce tempest-CreateVolumesFromSnapshotTest-774690854 None] Created volume successfully.
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Flow 'volume_create_manager' (3ac9e5c7-bfe1-4345-82e5-3cea8c3fad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0981cd6-be61-407c-a44d-bd84cb28d58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0981cd6-be61-407c-a44d-bd84cb28d58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686124393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=215fea65-aef8-40bc-8760-5362035c9ff6,host='devstack@QuobyteHD#QuobyteHD',id=cc8d2fcf-c600-4d49-867e-b1ea9854f91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fa555e87e0481096a052cdf433709f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:35Z,use_quota=True,user_id='fa8f8aa61cf746399e8d2185c9ef7ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56c66e37-369a-42ec-89a2-b3fac5f932f6),volume_type_id=56c66e37-369a-42ec-89a2-b3fac5f932f6)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3290db4a-33e1-419f-90ad-a39a26a7588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3290db4a-33e1-419f-90ad-a39a26a7588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc20286-f550-4bba-973b-0022aad46ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc20286-f550-4bba-973b-0022aad46ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8d2fcf-c600-4d49-867e-b1ea9854f91c', 'volume_name': 'volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab756dc-1e4e-4e75-bb3e-baf0072e81c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab756dc-1e4e-4e75-bb3e-baf0072e81c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672fbe5a-fbad-4882-b5e4-a20f025473a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Volume cc8d2fcf-c600-4d49-867e-b1ea9854f91c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c', 'volume_size': 1}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:35 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94 1073741824" returned: 0 in 0.422s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:35 devstack sudo[94622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94
Sep 06 17:02:35 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:36 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94" returned: 0 in 0.240s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=215fea65-aef8-40bc-8760-5362035c9ff6,created_at=2026-09-06T15:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1686124393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=215fea65-aef8-40bc-8760-5362035c9ff6,host='devstack@QuobyteHD#QuobyteHD',id=cc8d2fcf-c600-4d49-867e-b1ea9854f91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fa555e87e0481096a052cdf433709f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:35Z,use_quota=True,user_id='fa8f8aa61cf746399e8d2185c9ef7ebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56c66e37-369a-42ec-89a2-b3fac5f932f6),volume_type_id=56c66e37-369a-42ec-89a2-b3fac5f932f6)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Creating volume cc8d2fcf-c600-4d49-867e-b1ea9854f91c {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:36 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab3787b-72a1-488b-8072-7865ed48cfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ab1436-9b31-47d9-b267-15d7d742ee94', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:36 devstack sudo[94625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c 1073741824
Sep 06 17:02:36 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808fb2fb-f054-4462-bf5b-4cf363bb8ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:36 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Volume volume-31ab1436-9b31-47d9-b267-15d7d742ee94 (31ab1436-9b31-47d9-b267-15d7d742ee94): created successfully
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808fb2fb-f054-4462-bf5b-4cf363bb8ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Flow 'volume_create_manager' (0e096731-e466-491b-befa-a494a3d12ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1eae6b39-0948-426d-bcdc-830dd18e2782 tempest-AttachVolumeTestJSON-1172774509 None] Created volume successfully.
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-quobyte-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a6acf2-2f6a-42d6-9654-29e3f4213de3]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:36 devstack sudo[94630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1
Sep 06 17:02:36 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:36 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c 1073741824" returned: 0 in 0.474s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:36 devstack sudo[94637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c
Sep 06 17:02:36 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:36 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1" returned: 0 in 0.414s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:36 devstack sudo[94642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1
Sep 06 17:02:36 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:36 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" returned: 0 in 0.295s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672fbe5a-fbad-4882-b5e4-a20f025473a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733cda9c-12d5-4597-96ce-d6504fafd932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:36 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Volume volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c (cc8d2fcf-c600-4d49-867e-b1ea9854f91c): created successfully
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (733cda9c-12d5-4597-96ce-d6504fafd932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Flow 'volume_create_manager' (3ac9e5c7-bfe1-4345-82e5-3cea8c3fad22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-85f643de-5fa3-4342-9932-97297b5930f6 tempest-GroupSnapshotsV319Test-1221526725 None] Created volume successfully.
Sep 06 17:02:37 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1" returned: 0 in 0.278s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1" released by "delete_volume" :: held 0.734s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Created reservations ['6dc755a7-c422-4679-b659-df61f99d1262', '55cb09d4-81db-4f36-87d4-6a2eabf29bb2', '8467d8ca-8ce5-454c-b4ad-0d5030a40717', '7d2da92f-95c7-48b6-ae2b-fb27767dd083'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:37 devstack sudo[94655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:37 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-0dd6574d-8dfa-407d-9d12-4d51ffa919b4 req-102e279a-3544-4438-a944-e4e2e6e333e9 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-0dd6574d-8dfa-407d-9d12-4d51ffa919b4 req-102e279a-3544-4438-a944-e4e2e6e333e9 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-0dd6574d-8dfa-407d-9d12-4d51ffa919b4 req-102e279a-3544-4438-a944-e4e2e6e333e9 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-0dd6574d-8dfa-407d-9d12-4d51ffa919b4 req-102e279a-3544-4438-a944-e4e2e6e333e9 tempest-AttachVolumeTestJSON-1172774509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-31ab1436-9b31-47d9-b267-15d7d742ee94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ae1fc45-c46c-4b54-be77-6441ccbeddc2', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:02:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-0dd6574d-8dfa-407d-9d12-4d51ffa919b4 req-102e279a-3544-4438-a944-e4e2e6e333e9 tempest-AttachVolumeTestJSON-1172774509 None] attachment_update completed successfully.
Sep 06 17:02:37 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-b157265e-0f3a-4752-8305-dfaa9021ab1d-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.251s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Deleted volume successfully.
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-b157265e-0f3a-4752-8305-dfaa9021ab1d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3b47fa02-ef5b-4e72-969b-ee0c17c3ad08 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-1d09a8bd-63b6-4ba6-81f3-37fca6532cd1-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-quobyte-b157265e-0f3a-4752-8305-dfaa9021ab1d" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-b157265e-0f3a-4752-8305-dfaa9021ab1d" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba39937-dcc9-4ce6-8d9f-f1debc2a5a6f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:37 devstack sudo[94725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d
Sep 06 17:02:37 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:37 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d" returned: 0 in 0.399s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:37 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d
Sep 06 17:02:37 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] GroupSnapshot 27a2a427-57d7-42c1-94ac-df30a456c351: creating.
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Group snapshot 27a2a427-57d7-42c1-94ac-df30a456c351: creating. {{(pid=87474) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Creating offline snapshot 55cb7903-2492-41ed-b3d6-63e95b9ee477 of volume cc8d2fcf-c600-4d49-867e-b1ea9854f91c {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4ae551-5b17-4bc5-91f9-4101c9e0fbc6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:38 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b157265e-0f3a-4752-8305-dfaa9021ab1d" returned: 0 in 0.311s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-b157265e-0f3a-4752-8305-dfaa9021ab1d" released by "delete_volume" :: held 0.754s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Created reservations ['b874b4de-baa0-4d7f-b833-63e9529e7423', 'ebef5b57-f96c-4a44-bcc8-d67cd8a715db', '926b7f4a-dd59-48ac-84dd-8d9076c27df9', '5c2f078e-af23-44e0-92cc-bd82e8229dff'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:38 devstack sudo[95048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c
Sep 06 17:02:38 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:38 devstack sudo[95050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:38 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:38 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" returned: 0 in 0.376s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:38 devstack sudo[95056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 1G
Sep 06 17:02:38 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-quobyte-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:38 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.360s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Deleted volume successfully.
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[affa9ba1-63bd-4f2a-826e-d643eb6a5a7b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5e0d80e8-ecef-4133-a6e5-67e01a503ca9 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-b157265e-0f3a-4752-8305-dfaa9021ab1d-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:38 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4
Sep 06 17:02:38 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Flow 'volume_create_manager' (a7fef835-342c-427e-b9e4-4f42469024f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa4e843-7955-487e-8d25-e1f2fd5d0c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa4e843-7955-487e-8d25-e1f2fd5d0c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-986682109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fe8644-deeb-4c63-bf07-af4551b6a5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b421adef30ab484f9ab3c94acb66ea17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:39Z,use_quota=True,user_id='bf445686762c4711b6b22265e2160b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af3c086-5f96-4114-adb9-9b99c8e37d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af3c086-5f96-4114-adb9-9b99c8e37d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464e5ee7-8838-4286-9d9f-838f41f00c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (464e5ee7-8838-4286-9d9f-838f41f00c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95fe8644-deeb-4c63-bf07-af4551b6a5bd', 'volume_name': 'volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf6786b-8e82-4372-83ef-dbcfb57fea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf6786b-8e82-4372-83ef-dbcfb57fea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0cf7dd-cbcd-4c61-8602-6fa6e4b2b38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:39 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Volume 95fe8644-deeb-4c63-bf07-af4551b6a5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd', 'volume_size': 1}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:39 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 1G" returned: 0 in 0.520s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:39 devstack sudo[95066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477
Sep 06 17:02:39 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:39 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4" returned: 0 in 0.441s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:39 devstack sudo[95070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4
Sep 06 17:02:39 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:39 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477" returned: 0 in 0.300s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:39 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:39 devstack sudo[95076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477
Sep 06 17:02:39 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:39 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4" returned: 0 in 0.251s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4" released by "delete_volume" :: held 0.749s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Created reservations ['f20db4cb-f49d-48a4-937c-36fee5f1c735', '67605798-458d-4786-8a6a-62e10c775860', 'b74c7110-83d2-415a-9309-26527ba0598c', 'bf898a39-71f9-4c8e-81a2-458be42fb71a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:39 devstack sudo[95078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:39 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:39 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477" returned: 0 in 0.244s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:39 devstack sudo[95081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.info
Sep 06 17:02:39 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-3d7aa0a7-081f-446f-bd79-bb36e1f30195-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-3d7aa0a7-081f-446f-bd79-bb36e1f30195-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:39 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.293s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-quobyte-3d7aa0a7-081f-446f-bd79-bb36e1f30195" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:39 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Deleted volume successfully.
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-3d7aa0a7-081f-446f-bd79-bb36e1f30195" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-873b53ff-4466-4c92-a1fb-b762d6e5a2aa tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-71ab6864-c90c-4b91-a58c-adf1a4fa0aa4-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f5944e-da2a-4cb2-9c51-8699806ba650]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:40 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.info" returned: 0 in 0.303s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:40 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:40 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.info
Sep 06 17:02:40 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:40 devstack sudo[95084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195
Sep 06 17:02:40 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:40 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.info" returned: 0 in 0.292s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.211s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-986682109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95fe8644-deeb-4c63-bf07-af4551b6a5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b421adef30ab484f9ab3c94acb66ea17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:39Z,use_quota=True,user_id='bf445686762c4711b6b22265e2160b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Creating volume 95fe8644-deeb-4c63-bf07-af4551b6a5bd {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:40 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:40 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:40 devstack sudo[95093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd 1073741824
Sep 06 17:02:40 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195" returned: 0 in 0.424s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:40 devstack sudo[95095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195
Sep 06 17:02:40 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ac117861-b81d-4c2b-8e16-f7f544231fab tempest-GroupSnapshotsV319Test-1221526725 None] group_snapshot 27a2a427-57d7-42c1-94ac-df30a456c351: created successfully
Sep 06 17:02:40 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3d7aa0a7-081f-446f-bd79-bb36e1f30195" returned: 0 in 0.245s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-3d7aa0a7-081f-446f-bd79-bb36e1f30195" released by "delete_volume" :: held 0.714s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Created reservations ['49715daf-a245-407b-bfc3-e494c0ff73c0', '69c0da31-a6bb-4adc-91a8-6a78ff2e0aa6', '057e0d47-9229-448c-95be-f9bafb0f0fee', '71b701dc-92a7-4274-a4ed-74bdaa013933'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:40 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd 1073741824" returned: 0 in 0.438s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:40 devstack sudo[95102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:40 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:40 devstack sudo[95104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd
Sep 06 17:02:40 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:41 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-812c7df6-0ae5-4990-a4ee-2a3d230c73b7-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Deleted volume successfully.
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-812c7df6-0ae5-4990-a4ee-2a3d230c73b7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f270ad0-6c24-4434-943e-a5d0bf2998a7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-3d7aa0a7-081f-446f-bd79-bb36e1f30195-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:41 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd" returned: 0 in 0.292s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-quobyte-812c7df6-0ae5-4990-a4ee-2a3d230c73b7" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0cf7dd-cbcd-4c61-8602-6fa6e4b2b38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a946cd1f-261f-4a81-816f-ec8bac085fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-812c7df6-0ae5-4990-a4ee-2a3d230c73b7" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:41 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Volume volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd (95fe8644-deeb-4c63-bf07-af4551b6a5bd): created successfully
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a946cd1f-261f-4a81-816f-ec8bac085fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Flow 'volume_create_manager' (a7fef835-342c-427e-b9e4-4f42469024f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5a9cc0-8fd2-48ae-8b11-1c31881a8b15]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-adca0729-7d79-42bb-a19b-310133a2058b tempest-AttachVolumeTestJSON-1172774509 None] Created volume successfully.
Sep 06 17:02:41 devstack sudo[95109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7
Sep 06 17:02:41 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:41 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7" returned: 0 in 0.379s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:41 devstack sudo[95114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7
Sep 06 17:02:41 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] group_snapshot 27a2a427-57d7-42c1-94ac-df30a456c351: deleting
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] group_snapshot 27a2a427-57d7-42c1-94ac-df30a456c351: deleting {{(pid=87474) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Acquiring lock "cinder-quobyte-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Lock "cinder-quobyte-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Acquiring lock "cinder-quobyte-55cb7903-2492-41ed-b3d6-63e95b9ee477" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:41 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-812c7df6-0ae5-4990-a4ee-2a3d230c73b7" returned: 0 in 0.248s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-812c7df6-0ae5-4990-a4ee-2a3d230c73b7" released by "delete_volume" :: held 0.666s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Lock "cinder-quobyte-55cb7903-2492-41ed-b3d6-63e95b9ee477" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Deleting offline snapshot 55cb7903-2492-41ed-b3d6-63e95b9ee477 of volume cc8d2fcf-c600-4d49-867e-b1ea9854f91c {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] snapshot_file for this snap is: volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a60f719-ac05-472a-a3f9-37c175ce3006]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Created reservations ['781b2098-c62b-4f19-a726-a67368fdbead', '473a6588-e72c-4c8f-bdc1-a37a4346ccfc', 'e71e0e65-ee41-4370-9487-46c135dcc9da', '0584e136-ec1a-4b2e-82da-6f229f033270'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:41 devstack sudo[95117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477
Sep 06 17:02:41 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:42 devstack sudo[95119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:42 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:42 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.252s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-94080d81-dfac-4671-8218-2549977b8713-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:42 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Deleted volume successfully.
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-94080d81-dfac-4671-8218-2549977b8713-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-quobyte-79c1a2cd-1edd-42c0-a553-d98462a46afa" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a27e2c8d-a5fc-4866-abcb-4c229834afd7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-812c7df6-0ae5-4990-a4ee-2a3d230c73b7-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-79c1a2cd-1edd-42c0-a553-d98462a46afa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-quobyte-94080d81-dfac-4671-8218-2549977b8713" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:42 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477" returned: 0 in 0.454s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-94080d81-dfac-4671-8218-2549977b8713" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Deleting offline snapshot 94080d81-dfac-4671-8218-2549977b8713 of volume 79c1a2cd-1edd-42c0-a553-d98462a46afa {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] snapshot_file for this snap is: volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[604028c8-4c0d-48a2-b88e-6585c00be25f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7602f57-cff8-4c78-816c-89e0f6a359d7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:42 devstack sudo[95129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713
Sep 06 17:02:42 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:42 devstack sudo[95127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c
Sep 06 17:02:42 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:42 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713" returned: 0 in 0.394s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79c1a2cd-1edd-42c0-a553-d98462a46afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:02:42 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" returned: 0 in 0.457s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[066427cb-6861-4a4f-91d6-c83ad64df20e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:42 devstack sudo[95139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477
Sep 06 17:02:42 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:42 devstack sudo[95140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa
Sep 06 17:02:42 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:43 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477" returned: 0 in 0.383s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:43 devstack sudo[95159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477
Sep 06 17:02:43 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-c34f2b06-89eb-48c5-9cd9-fb6d470e9ba6 req-55d73811-2634-4de6-9bc3-b6d51c0f4dd1 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-c34f2b06-89eb-48c5-9cd9-fb6d470e9ba6 req-55d73811-2634-4de6-9bc3-b6d51c0f4dd1 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-c34f2b06-89eb-48c5-9cd9-fb6d470e9ba6 req-55d73811-2634-4de6-9bc3-b6d51c0f4dd1 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:43 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa" returned: 0 in 0.458s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-c34f2b06-89eb-48c5-9cd9-fb6d470e9ba6 req-55d73811-2634-4de6-9bc3-b6d51c0f4dd1 tempest-AttachVolumeTestJSON-1172774509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c094e46-188f-4fce-ac20-1314f9be573c', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:02:43 devstack sudo[95162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713
Sep 06 17:02:43 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-c34f2b06-89eb-48c5-9cd9-fb6d470e9ba6 req-55d73811-2634-4de6-9bc3-b6d51c0f4dd1 tempest-AttachVolumeTestJSON-1172774509 None] attachment_update completed successfully.
Sep 06 17:02:43 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c.55cb7903-2492-41ed-b3d6-63e95b9ee477" returned: 0 in 0.311s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Lock "cinder-quobyte-55cb7903-2492-41ed-b3d6-63e95b9ee477" released by "_delete_snapshot" :: held 1.721s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Lock "cinder-quobyte-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" released by "delete_snapshot" :: held 1.756s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:43 devstack cinder-volume[87474]: WARNING cinder.quota [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1349257452 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1349257452, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:02:43 devstack cinder-volume[87474]: WARNING cinder.quota [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1349257452 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1349257452, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] Created reservations ['aa036352-d8f1-4e5f-818a-26cd28a12504', '5551d9e1-da0d-462e-9862-bfb8db6937e1', '714f684c-74c4-4cd1-9214-42507ed5261b', '0a2fe404-9e77-430b-aab4-e629e2ddd22d'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:43 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713" returned: 0 in 0.441s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-89d609d2-79ac-4519-bb7a-edaac27412ce tempest-GroupSnapshotsV319Test-1221526725 None] group_snapshot 27a2a427-57d7-42c1-94ac-df30a456c351: deleted successfully
Sep 06 17:02:43 devstack sudo[95172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713
Sep 06 17:02:43 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:43 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa.94080d81-dfac-4671-8218-2549977b8713" returned: 0 in 0.259s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-94080d81-dfac-4671-8218-2549977b8713" released by "_delete_snapshot" :: held 1.703s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-79c1a2cd-1edd-42c0-a553-d98462a46afa" released by "delete_snapshot" :: held 1.747s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Created reservations ['a87505de-ce14-4b2f-8257-0f2064968562', '2c8c3fd5-d4bc-4458-90a1-c5cc86c13250', '7476ca36-e356-4b7b-9cd4-39a86b37862b', 'd598cfe4-c734-44c3-9db2-443dc90f2169'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:44 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Delete snapshot completed successfully.
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2994bd98-6b31-4a92-84af-eb046b092da7 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-94080d81-dfac-4671-8218-2549977b8713-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Acquiring lock "cinder-quobyte-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Lock "cinder-quobyte-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ac72c7-a841-4dbf-81e8-0f35bdf46bf6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-79c1a2cd-1edd-42c0-a553-d98462a46afa-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-79c1a2cd-1edd-42c0-a553-d98462a46afa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "cinder-quobyte-79c1a2cd-1edd-42c0-a553-d98462a46afa" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-79c1a2cd-1edd-42c0-a553-d98462a46afa" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cb6423-bf07-4ab0-a15f-16a7aa4b933c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:44 devstack sudo[95177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c
Sep 06 17:02:44 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:44 devstack sudo[95179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa
Sep 06 17:02:44 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:44 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" returned: 0 in 0.473s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:44 devstack sudo[95186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c
Sep 06 17:02:44 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:45 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa" returned: 0 in 0.412s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:45 devstack sudo[95192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa
Sep 06 17:02:45 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:45 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" returned: 0 in 0.293s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-38cfedec-65c4-41ee-92d6-237bde99767d req-32fcb6c7-40e5-4805-a493-f2b8ee396d19 tempest-AttachVolumeTestJSON-1172774509 None] Terminate volume connection completed successfully.
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-38cfedec-65c4-41ee-92d6-237bde99767d req-32fcb6c7-40e5-4805-a493-f2b8ee396d19 tempest-AttachVolumeTestJSON-1172774509 None] Deleting attachment 2ae1fc45-c46c-4b54-be77-6441ccbeddc2. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Lock "cinder-quobyte-cc8d2fcf-c600-4d49-867e-b1ea9854f91c" released by "delete_volume" :: held 0.858s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Created reservations ['67401694-dc4c-42f4-b630-868e7107be24'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:45 devstack cinder-volume[87474]: WARNING cinder.quota [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1349257452 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1349257452, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:02:45 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-79c1a2cd-1edd-42c0-a553-d98462a46afa" returned: 0 in 0.309s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Created reservations ['d583ce80-5054-4f9e-8c6b-d9b9cb3d2c3b', 'e7d40f7b-5448-49bb-a25f-7c5b18f5f0c8', 'f6f534e0-9713-4e3d-838c-5866ab0fd4e5', '9064f67d-c7e4-4a83-a986-7fe9f03ac004'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-quobyte-79c1a2cd-1edd-42c0-a553-d98462a46afa" released by "delete_volume" :: held 0.804s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Created reservations ['80ec292d-0864-445d-8d31-2fc1fe3131bc', 'cb9f6b0a-2874-42cb-a624-ae87eb92d14f', '13830d75-ecb8-437f-8b87-2fabbef7d917', 'cf2105ca-7ea1-4510-8b19-981aec507cee'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:45 devstack sudo[95197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:45 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:45 devstack sudo[95199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:45 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:45 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-25d7799a-5ba0-40f2-b1f6-fcc4f1239a45 tempest-GroupSnapshotsV319Test-1221526725 None] Delete group completed successfully.
Sep 06 17:02:45 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.331s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Deleted volume successfully.
Sep 06 17:02:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8e4b2361-f1d3-4d59-8a6d-d2b24ddbf018 tempest-CreateVolumesFromSnapshotTest-774690854 None] Lock "cinder-79c1a2cd-1edd-42c0-a553-d98462a46afa-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:46 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-5bcc17b2-eb61-467c-b4c9-85fa278d4636 req-3526f174-f302-4b34-bcd9-762b249418e6 tempest-AttachVolumeTestJSON-1172774509 None] Terminate volume connection completed successfully.
Sep 06 17:02:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-5bcc17b2-eb61-467c-b4c9-85fa278d4636 req-3526f174-f302-4b34-bcd9-762b249418e6 tempest-AttachVolumeTestJSON-1172774509 None] Deleting attachment 2c094e46-188f-4fce-ac20-1314f9be573c. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:02:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "cinder-95fe8644-deeb-4c63-bf07-af4551b6a5bd-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-95fe8644-deeb-4c63-bf07-af4551b6a5bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "cinder-quobyte-95fe8644-deeb-4c63-bf07-af4551b6a5bd" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-quobyte-95fe8644-deeb-4c63-bf07-af4551b6a5bd" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a2b726-9641-4a9e-b041-cb54b53c0e11]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:52 devstack sudo[95257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd
Sep 06 17:02:52 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:52 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd" returned: 0 in 0.414s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:52 devstack sudo[95262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd
Sep 06 17:02:52 devstack sudo[95262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:52 devstack sudo[95262]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-95fe8644-deeb-4c63-bf07-af4551b6a5bd" returned: 0 in 0.288s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-quobyte-95fe8644-deeb-4c63-bf07-af4551b6a5bd" released by "delete_volume" :: held 0.749s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Created reservations ['c14679af-e97f-46b6-b247-115683973592', '5d0fae44-e1aa-45aa-bdff-715229786c8b', '989d5dbe-c224-4b48-a377-74737b9daf3b', '734f8476-3913-40a9-b205-b2abc5857e09'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:52 devstack sudo[95265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:52 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "cinder-31ab1436-9b31-47d9-b267-15d7d742ee94-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-31ab1436-9b31-47d9-b267-15d7d742ee94-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "cinder-quobyte-31ab1436-9b31-47d9-b267-15d7d742ee94" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:53 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.340s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-quobyte-31ab1436-9b31-47d9-b267-15d7d742ee94" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:53 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Deleted volume successfully.
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8e3ce-1753-48f8-a32a-bb08bd909972]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7a21329-eba1-40ec-88bf-6e0100d5ce54 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-95fe8644-deeb-4c63-bf07-af4551b6a5bd-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:53 devstack sudo[95268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94
Sep 06 17:02:53 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:53 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94" returned: 0 in 0.421s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:53 devstack sudo[95273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94
Sep 06 17:02:53 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:53 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-31ab1436-9b31-47d9-b267-15d7d742ee94" returned: 0 in 0.269s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-quobyte-31ab1436-9b31-47d9-b267-15d7d742ee94" released by "delete_volume" :: held 0.750s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:53 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Created reservations ['8c14acc2-a9de-4dc5-b8c0-0e879a374810', '6a5aad10-9106-4bda-895d-83f1a5fca9d2', '9fd0bce6-31dc-4450-a584-338e16ed6924', 'a77538eb-db30-4071-af1d-a40768c88fd0'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:54 devstack sudo[95276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:54 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "cinder-882d9e7b-4869-45a8-b749-af07c97a5fed-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:54 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.369s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-882d9e7b-4869-45a8-b749-af07c97a5fed-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Deleted volume successfully.
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d7690459-b4c8-4301-94d9-608bb535f3d3 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-31ab1436-9b31-47d9-b267-15d7d742ee94-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "cinder-quobyte-882d9e7b-4869-45a8-b749-af07c97a5fed" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-quobyte-882d9e7b-4869-45a8-b749-af07c97a5fed" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4331195-6fc0-4ad4-9c70-9bd52e5fa369]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:54 devstack sudo[95279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed
Sep 06 17:02:54 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:55 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed" returned: 0 in 0.438s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:55 devstack sudo[95284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed
Sep 06 17:02:55 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:55 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-882d9e7b-4869-45a8-b749-af07c97a5fed" returned: 0 in 0.308s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-quobyte-882d9e7b-4869-45a8-b749-af07c97a5fed" released by "delete_volume" :: held 0.803s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Created reservations ['4c91a588-b221-4a18-8ab2-a0c1c1e9e7cc', '2a7d053c-726d-4faf-bad2-69093e301948', 'f69e0fb6-3bf3-4429-adba-66be462ac3e7', 'e662cb5c-e7a9-41f2-bddc-f90b0a984e0a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:55 devstack sudo[95287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:02:55 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:55 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.289s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:02:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Deleted volume successfully.
Sep 06 17:02:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-70ca18d9-cd6e-43bb-9318-49414c837e71 tempest-AttachVolumeTestJSON-1172774509 None] Lock "cinder-882d9e7b-4869-45a8-b749-af07c97a5fed-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Flow 'volume_create_manager' (b141d00c-ed72-41c3-a5c9-c4d262d18ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a6430d-e98b-4b65-a941-0432b5695400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a6430d-e98b-4b65-a941-0432b5695400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090430824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317851c7-74fe-4fac-aa56-77c11d08f13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f0fc96c1c4c99af38719be10d9799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:57Z,use_quota=True,user_id='72a8116e0b82494c8a80df3edff02f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1d1fb8-1345-4782-b2a8-da46b269a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1d1fb8-1345-4782-b2a8-da46b269a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16788bb0-4397-4c73-92f2-ce0a32c33ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16788bb0-4397-4c73-92f2-ce0a32c33ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317851c7-74fe-4fac-aa56-77c11d08f13e', 'volume_name': 'volume-317851c7-74fe-4fac-aa56-77c11d08f13e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5eedd67-7d6d-4d0f-9ccb-b04accd22224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5eedd67-7d6d-4d0f-9ccb-b04accd22224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a610c28d-790e-4933-abb6-8536005bdc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:57 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Volume 317851c7-74fe-4fac-aa56-77c11d08f13e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317851c7-74fe-4fac-aa56-77c11d08f13e', 'volume_size': 1}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090430824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317851c7-74fe-4fac-aa56-77c11d08f13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f0fc96c1c4c99af38719be10d9799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:02:57Z,use_quota=True,user_id='72a8116e0b82494c8a80df3edff02f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Creating volume 317851c7-74fe-4fac-aa56-77c11d08f13e {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:02:57 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:57 devstack sudo[95326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e 1073741824
Sep 06 17:02:57 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:57 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e 1073741824" returned: 0 in 0.535s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:57 devstack sudo[95333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e
Sep 06 17:02:57 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:02:58 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root
Sep 06 17:02:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:02:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:02:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:02:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a610c28d-790e-4933-abb6-8536005bdc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317851c7-74fe-4fac-aa56-77c11d08f13e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35be1675-b90b-446a-9c24-6edf6463732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:02:58 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Volume volume-317851c7-74fe-4fac-aa56-77c11d08f13e (317851c7-74fe-4fac-aa56-77c11d08f13e): created successfully
Sep 06 17:02:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35be1675-b90b-446a-9c24-6edf6463732e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:02:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Flow 'volume_create_manager' (b141d00c-ed72-41c3-a5c9-c4d262d18ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:02:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1c18757c-7f30-401b-88fc-42ac78fe46a4 tempest-ProjectReaderTests-646972033 None] Created volume successfully.
Sep 06 17:02:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Acquiring lock "cinder-317851c7-74fe-4fac-aa56-77c11d08f13e-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Lock "cinder-317851c7-74fe-4fac-aa56-77c11d08f13e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Acquiring lock "cinder-quobyte-317851c7-74fe-4fac-aa56-77c11d08f13e" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:02:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Lock "cinder-quobyte-317851c7-74fe-4fac-aa56-77c11d08f13e" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:02:59 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f366e-8e5f-4980-94cf-6e2c057e3e95]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:02:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:02:59 devstack sudo[95336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e
Sep 06 17:02:59 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:00 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e" returned: 0 in 0.451s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:00 devstack sudo[95341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e
Sep 06 17:03:00 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:00 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-317851c7-74fe-4fac-aa56-77c11d08f13e" returned: 0 in 0.280s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Lock "cinder-quobyte-317851c7-74fe-4fac-aa56-77c11d08f13e" released by "delete_volume" :: held 0.797s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Created reservations ['240f7357-0991-4692-b901-3958100fe41e', '2fcaa71a-22cf-489d-9b29-e21f24340843', 'eaa64c8a-6fe1-44c6-af1a-a6bfe166f8a0', '68c5fe0c-7e40-4d40-af03-287773d3a443'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:00 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:00 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:00 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:00 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:01 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Deleted volume successfully.
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=196,cinder:SELECT=140,cinder:DELETE=19,cinder:INSERT=40 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-64baebe6-7baf-4846-862e-0df2707e6e6d tempest-ProjectReaderTests-646972033 None] Lock "cinder-317851c7-74fe-4fac-aa56-77c11d08f13e-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Flow 'volume_create_manager' (1c529688-8ecb-46dd-8571-cc607ddfd4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25f56e-72f4-4c8b-a8a2-13c7f6887dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=152,cinder:UPDATE=172,cinder:INSERT=45,cinder:DELETE=10 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25f56e-72f4-4c8b-a8a2-13c7f6887dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078815336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9eb7243-b1ad-4c70-8d96-137e1ce8e612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f0fc96c1c4c99af38719be10d9799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:01Z,use_quota=True,user_id='72a8116e0b82494c8a80df3edff02f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23055526-3e91-4f3c-9b6d-45183eb69aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23055526-3e91-4f3c-9b6d-45183eb69aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e3459e-8af7-47f9-95ea-1f089b5634c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e3459e-8af7-47f9-95ea-1f089b5634c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9eb7243-b1ad-4c70-8d96-137e1ce8e612', 'volume_name': 'volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8ada24-7e42-4c35-99b5-092d94ab161a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8ada24-7e42-4c35-99b5-092d94ab161a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5317d29-a107-46f9-9d86-e7bb43f1b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:01 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Volume d9eb7243-b1ad-4c70-8d96-137e1ce8e612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612', 'volume_size': 1}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078815336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9eb7243-b1ad-4c70-8d96-137e1ce8e612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f0fc96c1c4c99af38719be10d9799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:01Z,use_quota=True,user_id='72a8116e0b82494c8a80df3edff02f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Creating volume d9eb7243-b1ad-4c70-8d96-137e1ce8e612 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:01 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:01 devstack sudo[95349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612 1073741824
Sep 06 17:03:01 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:01 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612 1073741824" returned: 0 in 0.479s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:01 devstack sudo[95355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612
Sep 06 17:03:01 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:02 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612" returned: 0 in 0.296s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5317d29-a107-46f9-9d86-e7bb43f1b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6f9ca1-aa5f-4d35-804e-46161db4ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Volume volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612 (d9eb7243-b1ad-4c70-8d96-137e1ce8e612): created successfully
Sep 06 17:03:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6f9ca1-aa5f-4d35-804e-46161db4ee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Flow 'volume_create_manager' (1c529688-8ecb-46dd-8571-cc607ddfd4e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:02 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d57f1d7d-5637-4ad4-af24-1662c6b7b4cb tempest-ProjectReaderTests-646972033 None] Created volume successfully.
Sep 06 17:03:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Acquiring lock "cinder-d9eb7243-b1ad-4c70-8d96-137e1ce8e612-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Lock "cinder-d9eb7243-b1ad-4c70-8d96-137e1ce8e612-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Acquiring lock "cinder-quobyte-d9eb7243-b1ad-4c70-8d96-137e1ce8e612" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Lock "cinder-quobyte-d9eb7243-b1ad-4c70-8d96-137e1ce8e612" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:03 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0f4c81-ad33-4763-90ab-b0684fe04222]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:03 devstack sudo[95358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612
Sep 06 17:03:03 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:04 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612" returned: 0 in 0.430s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:04 devstack sudo[95363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612
Sep 06 17:03:04 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:04 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d9eb7243-b1ad-4c70-8d96-137e1ce8e612" returned: 0 in 0.315s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Lock "cinder-quobyte-d9eb7243-b1ad-4c70-8d96-137e1ce8e612" released by "delete_volume" :: held 0.801s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Created reservations ['fae6c492-882f-4fca-8507-f68a0f0d21e4', 'dd249c02-8626-4048-9adc-ea15a1bd8f7f', 'd3d19349-fd61-4d76-885a-71841f8070a6', 'fdef1b95-bd2c-4f34-aab3-f4028e1e3dbe'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:04 devstack sudo[95366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:04 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Flow 'volume_create_manager' (b46d93c2-5146-4ed1-8595-39a5de7f6774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62416bf-00d6-44fc-b707-b77b358082bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62416bf-00d6-44fc-b707-b77b358082bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1251342170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a3bf41-bae5-4946-abb9-8d546650cf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528b0306eb34466f9363a1c89c650409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:05Z,use_quota=True,user_id='8f1b27f1b4cc499898ec13d98c968b9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6474e6b9-6efa-4835-93e4-80997f223df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6474e6b9-6efa-4835-93e4-80997f223df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef136b78-e909-422a-8655-375f71fb6efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef136b78-e909-422a-8655-375f71fb6efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a3bf41-bae5-4946-abb9-8d546650cf5f', 'volume_name': 'volume-40a3bf41-bae5-4946-abb9-8d546650cf5f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de99a872-1d59-4f84-a9c7-7fedd241198c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de99a872-1d59-4f84-a9c7-7fedd241198c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557e83a4-95f2-495b-abb7-e744ceb09f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:04 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Volume 40a3bf41-bae5-4946-abb9-8d546650cf5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a3bf41-bae5-4946-abb9-8d546650cf5f', 'volume_size': 1}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1251342170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a3bf41-bae5-4946-abb9-8d546650cf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528b0306eb34466f9363a1c89c650409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:05Z,use_quota=True,user_id='8f1b27f1b4cc499898ec13d98c968b9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Creating volume 40a3bf41-bae5-4946-abb9-8d546650cf5f {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:04 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:04 devstack sudo[95369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f 1073741824
Sep 06 17:03:04 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:04 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.289s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:04 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Deleted volume successfully.
Sep 06 17:03:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f752a3fe-a10e-4d2e-a525-5ea4b9b45d47 tempest-ProjectReaderTests-646972033 None] Lock "cinder-d9eb7243-b1ad-4c70-8d96-137e1ce8e612-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Flow 'volume_create_manager' (6634e60c-27d8-4052-bcfd-90bdca6ac057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f674f51d-e719-4fbc-a36b-ee01a8f677d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f674f51d-e719-4fbc-a36b-ee01a8f677d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072241399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194bb7b1-1b62-4c9e-b868-4710e32d8754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f0fc96c1c4c99af38719be10d9799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:05Z,use_quota=True,user_id='72a8116e0b82494c8a80df3edff02f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb5182e-0443-4c00-adc3-13f4a90958f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb5182e-0443-4c00-adc3-13f4a90958f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37139ad-a62f-4eea-88ef-37b99a89644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37139ad-a62f-4eea-88ef-37b99a89644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194bb7b1-1b62-4c9e-b868-4710e32d8754', 'volume_name': 'volume-194bb7b1-1b62-4c9e-b868-4710e32d8754', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e66bdc-6ac8-4e66-8d10-a589b37a23b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e66bdc-6ac8-4e66-8d10-a589b37a23b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b33f31f-8782-4346-800d-52a108061689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:05 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Volume 194bb7b1-1b62-4c9e-b868-4710e32d8754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194bb7b1-1b62-4c9e-b868-4710e32d8754', 'volume_size': 1}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:05 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f 1073741824" returned: 0 in 0.610s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:05 devstack sudo[95374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f
Sep 06 17:03:05 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:05 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.391s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072241399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194bb7b1-1b62-4c9e-b868-4710e32d8754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f0fc96c1c4c99af38719be10d9799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:05Z,use_quota=True,user_id='72a8116e0b82494c8a80df3edff02f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Creating volume 194bb7b1-1b62-4c9e-b868-4710e32d8754 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:05 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557e83a4-95f2-495b-abb7-e744ceb09f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a3bf41-bae5-4946-abb9-8d546650cf5f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:05 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754 1073741824
Sep 06 17:03:05 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbd7e54-aa07-4252-8192-6ff9bd7f42d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:05 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Volume volume-40a3bf41-bae5-4946-abb9-8d546650cf5f (40a3bf41-bae5-4946-abb9-8d546650cf5f): created successfully
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbd7e54-aa07-4252-8192-6ff9bd7f42d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Flow 'volume_create_manager' (b46d93c2-5146-4ed1-8595-39a5de7f6774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-020cc0b4-1625-4537-b474-e884f297b4cf req-6463afb6-7e2f-44bc-908e-1ed14a2ae6a5 tempest-VolumesSnapshotsTestJSON-1136381143 None] Created volume successfully.
Sep 06 17:03:06 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754 1073741824" returned: 0 in 0.464s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:06 devstack sudo[95383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754
Sep 06 17:03:06 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:06 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754" returned: 0 in 0.263s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b33f31f-8782-4346-800d-52a108061689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194bb7b1-1b62-4c9e-b868-4710e32d8754', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d21648-d175-4fd1-b7dc-0d54a5443ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:06 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Volume volume-194bb7b1-1b62-4c9e-b868-4710e32d8754 (194bb7b1-1b62-4c9e-b868-4710e32d8754): created successfully
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d21648-d175-4fd1-b7dc-0d54a5443ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Flow 'volume_create_manager' (6634e60c-27d8-4052-bcfd-90bdca6ac057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0a2b69c9-acfc-444a-a6ba-9fe9a0e03d72 tempest-ProjectReaderTests-646972033 None] Created volume successfully.
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Creating offline snapshot fb4ede65-6bab-4dfd-a2da-62343a5ffd4b of volume 40a3bf41-bae5-4946-abb9-8d546650cf5f {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e912a24-d623-4cbc-b485-f8caf2303643]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:07 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f
Sep 06 17:03:07 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Acquiring lock "cinder-194bb7b1-1b62-4c9e-b868-4710e32d8754-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Lock "cinder-194bb7b1-1b62-4c9e-b868-4710e32d8754-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Acquiring lock "cinder-quobyte-194bb7b1-1b62-4c9e-b868-4710e32d8754" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:07 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f" returned: 0 in 0.422s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Lock "cinder-quobyte-194bb7b1-1b62-4c9e-b868-4710e32d8754" acquired by "delete_volume" :: waited 0.035s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:07 devstack sudo[95392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b 1G
Sep 06 17:03:07 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b1b93-bfb5-4182-8c19-5182c228ed02]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:07 devstack sudo[95394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754
Sep 06 17:03:07 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:07 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754" returned: 0 in 0.410s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:07 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b 1G" returned: 0 in 0.481s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a3bf41-bae5-4946-abb9-8d546650cf5f -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:07 devstack sudo[95402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754
Sep 06 17:03:07 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:07 devstack sudo[95403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a3bf41-bae5-4946-abb9-8d546650cf5f -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b
Sep 06 17:03:07 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:08 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-194bb7b1-1b62-4c9e-b868-4710e32d8754" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Lock "cinder-quobyte-194bb7b1-1b62-4c9e-b868-4710e32d8754" released by "delete_volume" :: held 0.731s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Created reservations ['6b696dd7-0c1c-4b53-9324-330312465d4c', '6988f693-9763-4a9f-963b-abf9afbe9fae', '0af4dd4e-2bfe-46d1-aa7f-9a1fed3370d2', 'f3463831-181f-4862-ae97-182d3bc4f7d9'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:08 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40a3bf41-bae5-4946-abb9-8d546650cf5f -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b" returned: 0 in 0.350s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:08 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b is being set with open permissions: ugo+rw
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:08 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b
Sep 06 17:03:08 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:08 devstack sudo[95412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:08 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Flow 'volume_create_manager' (3ab0b851-2fc5-4466-8228-5cca4befa545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc8d80b-48b0-4687-8877-8b43b72d55fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc8d80b-48b0-4687-8877-8b43b72d55fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-656978589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b14ca28-67d4-474a-a14e-04ef69294f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca601e1f0f334fff867a2c4c3c12a73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:08Z,use_quota=True,user_id='bded33ff7bfb4a54a5803289d9bf3858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43103f71-f75f-44af-b83c-ec045e3f5f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43103f71-f75f-44af-b83c-ec045e3f5f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4c5b04-6033-4dc0-bec6-26ad94a56d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4c5b04-6033-4dc0-bec6-26ad94a56d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b14ca28-67d4-474a-a14e-04ef69294f45', 'volume_name': 'volume-5b14ca28-67d4-474a-a14e-04ef69294f45', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382fa5c7-1358-4b4c-be7c-09b74b1ba682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382fa5c7-1358-4b4c-be7c-09b74b1ba682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb54c7b2-76dd-4431-a3ef-ee1c8bef83cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:08 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Volume 5b14ca28-67d4-474a-a14e-04ef69294f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b14ca28-67d4-474a-a14e-04ef69294f45', 'volume_size': 1}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:08 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b" returned: 0 in 0.358s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:08 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.314s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:08 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Deleted volume successfully.
Sep 06 17:03:08 devstack sudo[95416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.info
Sep 06 17:03:08 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-67993215-3c84-47d0-ae9c-335cdd479818 tempest-ProjectReaderTests-646972033 None] Lock "cinder-194bb7b1-1b62-4c9e-b868-4710e32d8754-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:08 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.info" returned: 0 in 0.297s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:08 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.info is being set with open permissions: ugo+rw
Sep 06 17:03:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:08 devstack sudo[95419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.info
Sep 06 17:03:08 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Flow 'volume_create_manager' (7b4833b7-9c46-479b-902c-4980aa9fcd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1628443f-4365-4d29-ab78-973ec5499e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1628443f-4365-4d29-ab78-973ec5499e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450120987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30cc4e2d-4026-4992-a358-270003abe716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f0fc96c1c4c99af38719be10d9799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:09Z,use_quota=True,user_id='72a8116e0b82494c8a80df3edff02f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c464410-743d-44c7-90ed-1d630fd8eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c464410-743d-44c7-90ed-1d630fd8eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab84f47-a17c-4d34-9eda-7ea2a152c7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab84f47-a17c-4d34-9eda-7ea2a152c7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30cc4e2d-4026-4992-a358-270003abe716', 'volume_name': 'volume-30cc4e2d-4026-4992-a358-270003abe716', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31007d2-abff-4435-a642-59a77a5040dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31007d2-abff-4435-a642-59a77a5040dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08f4c8e-1482-43c2-a302-7ac4e228eeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:09 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Volume 30cc4e2d-4026-4992-a358-270003abe716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30cc4e2d-4026-4992-a358-270003abe716', 'volume_size': 1}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:09 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.info" returned: 0 in 0.241s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.603s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-656978589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b14ca28-67d4-474a-a14e-04ef69294f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca601e1f0f334fff867a2c4c3c12a73b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:08Z,use_quota=True,user_id='bded33ff7bfb4a54a5803289d9bf3858',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Creating volume 5b14ca28-67d4-474a-a14e-04ef69294f45 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:09 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:09 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45 1073741824
Sep 06 17:03:09 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:09 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-e324ba6b-e72d-46a5-88ed-e90e0279cb60 req-13254cb9-9e6e-4798-8151-85228be3d44d tempest-VolumesSnapshotsTestJSON-1136381143 None] Create snapshot completed successfully
Sep 06 17:03:09 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45 1073741824" returned: 0 in 0.406s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:09 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45
Sep 06 17:03:09 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Acquiring lock "cinder-fb4ede65-6bab-4dfd-a2da-62343a5ffd4b-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-fb4ede65-6bab-4dfd-a2da-62343a5ffd4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Acquiring lock "cinder-quobyte-40a3bf41-bae5-4946-abb9-8d546650cf5f" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-quobyte-40a3bf41-bae5-4946-abb9-8d546650cf5f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Acquiring lock "cinder-quobyte-fb4ede65-6bab-4dfd-a2da-62343a5ffd4b" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-quobyte-fb4ede65-6bab-4dfd-a2da-62343a5ffd4b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Deleting offline snapshot fb4ede65-6bab-4dfd-a2da-62343a5ffd4b of volume 40a3bf41-bae5-4946-abb9-8d546650cf5f {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] snapshot_file for this snap is: volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:03:09 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a3ebac-2a4f-4b26-ac6d-dc92e6dc2f75]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450120987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30cc4e2d-4026-4992-a358-270003abe716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f0fc96c1c4c99af38719be10d9799',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:09Z,use_quota=True,user_id='72a8116e0b82494c8a80df3edff02f2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Creating volume 30cc4e2d-4026-4992-a358-270003abe716 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:09 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb54c7b2-76dd-4431-a3ef-ee1c8bef83cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b14ca28-67d4-474a-a14e-04ef69294f45', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:09 devstack sudo[95432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716 1073741824
Sep 06 17:03:09 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec835ca9-b800-47cd-aff7-e212ff1973df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:09 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Volume volume-5b14ca28-67d4-474a-a14e-04ef69294f45 (5b14ca28-67d4-474a-a14e-04ef69294f45): created successfully
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec835ca9-b800-47cd-aff7-e212ff1973df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Flow 'volume_create_manager' (3ab0b851-2fc5-4466-8228-5cca4befa545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:10 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3b9b2fb2-6dbb-4fa8-992d-16314e403a2f tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Created volume successfully.
Sep 06 17:03:10 devstack sudo[95431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b
Sep 06 17:03:10 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:10 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40a3bf41-bae5-4946-abb9-8d546650cf5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67e322d-43f3-49ee-9e2d-e6d234329f1d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:10 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716 1073741824" returned: 0 in 0.432s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:10 devstack sudo[95442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f
Sep 06 17:03:10 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:10 devstack sudo[95444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716
Sep 06 17:03:10 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:10 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716" returned: 0 in 0.270s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:10 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f" returned: 0 in 0.406s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08f4c8e-1482-43c2-a302-7ac4e228eeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30cc4e2d-4026-4992-a358-270003abe716', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:10 devstack sudo[95452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b
Sep 06 17:03:10 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c13e912-e723-4a84-99df-900054a5e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:10 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Volume volume-30cc4e2d-4026-4992-a358-270003abe716 (30cc4e2d-4026-4992-a358-270003abe716): created successfully
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c13e912-e723-4a84-99df-900054a5e424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Flow 'volume_create_manager' (7b4833b7-9c46-479b-902c-4980aa9fcd1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:10 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-db85dc7a-3154-413c-98b9-158b5e0ba52b tempest-ProjectReaderTests-646972033 None] Created volume successfully.
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Creating offline snapshot 9a2de2c1-c467-4f69-a03d-a18d797f31a7 of volume 5b14ca28-67d4-474a-a14e-04ef69294f45 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab53ef4-68bc-481d-8024-bffd45c4cac6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:10 devstack sudo[95454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45
Sep 06 17:03:10 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:11 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b" returned: 0 in 0.332s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:11 devstack sudo[95459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b
Sep 06 17:03:11 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:11 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45" returned: 0 in 0.409s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:11 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 1G
Sep 06 17:03:11 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Acquiring lock "cinder-30cc4e2d-4026-4992-a358-270003abe716-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Lock "cinder-30cc4e2d-4026-4992-a358-270003abe716-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Acquiring lock "cinder-quobyte-30cc4e2d-4026-4992-a358-270003abe716" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Lock "cinder-quobyte-30cc4e2d-4026-4992-a358-270003abe716" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:11 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f.fb4ede65-6bab-4dfd-a2da-62343a5ffd4b" returned: 0 in 0.311s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8114e94-fc05-4df1-aec4-f1523155db98]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-quobyte-fb4ede65-6bab-4dfd-a2da-62343a5ffd4b" released by "_delete_snapshot" :: held 1.509s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-quobyte-40a3bf41-bae5-4946-abb9-8d546650cf5f" released by "delete_snapshot" :: held 1.539s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG cinder.quota [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Created reservations ['fd2947cb-99a2-4da7-a1f9-9ca5e87a624c', '8a01913c-da44-4550-9435-9da3c09cb27c', 'f5280e19-84bf-45b1-9c3b-0df88767a799', '82a9da55-496d-4ab1-9c7f-c9a3a129b970'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:11 devstack sudo[95468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716
Sep 06 17:03:11 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:11 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Delete snapshot completed successfully.
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-080dcb9f-02f4-456b-a603-0d3a020880a5 req-72182d81-ba8c-4bd0-831d-064aae38632e tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-fb4ede65-6bab-4dfd-a2da-62343a5ffd4b-delete_snapshot" released by "delete_snapshot" :: held 1.686s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:11 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 1G" returned: 0 in 0.462s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b14ca28-67d4-474a-a14e-04ef69294f45 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:11 devstack sudo[95473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b14ca28-67d4-474a-a14e-04ef69294f45 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7
Sep 06 17:03:11 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:11 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716" returned: 0 in 0.401s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:11 devstack sudo[95478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716
Sep 06 17:03:11 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:11 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b14ca28-67d4-474a-a14e-04ef69294f45 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7" returned: 0 in 0.306s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:11 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 is being set with open permissions: ugo+rw
Sep 06 17:03:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:12 devstack sudo[95484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7
Sep 06 17:03:12 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:12 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-30cc4e2d-4026-4992-a358-270003abe716" returned: 0 in 0.262s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Lock "cinder-quobyte-30cc4e2d-4026-4992-a358-270003abe716" released by "delete_volume" :: held 0.721s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Acquiring lock "cinder-40a3bf41-bae5-4946-abb9-8d546650cf5f-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-40a3bf41-bae5-4946-abb9-8d546650cf5f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Created reservations ['137b610f-54ab-4c52-bad2-840fb80cbeef', 'ba2047de-4cc6-4ead-a0ef-7186ff728631', '88040124-6a58-46b5-b6f3-4684ffd8a53a', 'f7ac5c08-cfea-49a1-ab67-6dab504b0b94'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Acquiring lock "cinder-quobyte-40a3bf41-bae5-4946-abb9-8d546650cf5f" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-quobyte-40a3bf41-bae5-4946-abb9-8d546650cf5f" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[80efaea2-965c-4bf3-aaf9-384f2e8da3c6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:12 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:12 devstack sudo[95488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:12 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:12 devstack sudo[95490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.info
Sep 06 17:03:12 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:12 devstack sudo[95487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f
Sep 06 17:03:12 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:12 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.285s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Deleted volume successfully.
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16b82e77-29f0-43a1-9cc9-3b7f1bd8684f tempest-ProjectReaderTests-646972033 None] Lock "cinder-30cc4e2d-4026-4992-a358-270003abe716-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:12 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.info" returned: 0 in 0.296s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:12 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.info is being set with open permissions: ugo+rw
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:12 devstack sudo[95498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.info
Sep 06 17:03:12 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:12 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f" returned: 0 in 0.407s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:12 devstack sudo[95500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f
Sep 06 17:03:12 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:12 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.info" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:12 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-40a3bf41-bae5-4946-abb9-8d546650cf5f" returned: 0 in 0.265s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f79ae940-af8c-4f5e-9e22-84d66fe77427 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Create snapshot completed successfully
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-quobyte-40a3bf41-bae5-4946-abb9-8d546650cf5f" released by "delete_volume" :: held 0.740s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:12 devstack cinder-volume[87474]: DEBUG cinder.quota [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Created reservations ['62ef35df-c9f1-4979-9b08-c11b75ba9576', 'caa061fa-c7fb-44e4-8d42-06df76f1cbc5', 'f9a4f519-7565-47bf-9aa0-b49feaf8a618', 'adcf7c41-0db1-4d5d-8d65-d16b40f9498c'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:13 devstack sudo[95504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:13 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:13 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.245s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:13 devstack cinder-volume[87474]: DEBUG cinder.manager [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:13 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Deleted volume successfully.
Sep 06 17:03:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-7fdcedb5-8f1a-46f0-a67e-a43e5834d136 req-1d16c527-b0a8-4380-9879-3c1b2d72f8dd tempest-VolumesSnapshotsTestJSON-1136381143 None] Lock "cinder-40a3bf41-bae5-4946-abb9-8d546650cf5f-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Acquiring lock "cinder-9a2de2c1-c467-4f69-a03d-a18d797f31a7-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-9a2de2c1-c467-4f69-a03d-a18d797f31a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Acquiring lock "cinder-quobyte-5b14ca28-67d4-474a-a14e-04ef69294f45" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-quobyte-5b14ca28-67d4-474a-a14e-04ef69294f45" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Acquiring lock "cinder-quobyte-9a2de2c1-c467-4f69-a03d-a18d797f31a7" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-quobyte-9a2de2c1-c467-4f69-a03d-a18d797f31a7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Deleting offline snapshot 9a2de2c1-c467-4f69-a03d-a18d797f31a7 of volume 5b14ca28-67d4-474a-a14e-04ef69294f45 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] snapshot_file for this snap is: volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[52405f27-0c35-4aa2-81a6-bff0b1dfdab1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:14 devstack sudo[95507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7
Sep 06 17:03:14 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:14 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7" returned: 0 in 0.443s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b14ca28-67d4-474a-a14e-04ef69294f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:03:15 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef69d75-4e5f-4659-a0b7-185228b62104]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:15 devstack sudo[95512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45
Sep 06 17:03:15 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:15 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45" returned: 0 in 0.379s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:15 devstack sudo[95517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7
Sep 06 17:03:15 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:15 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7" returned: 0 in 0.387s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:15 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7
Sep 06 17:03:15 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:16 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45.9a2de2c1-c467-4f69-a03d-a18d797f31a7" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-quobyte-9a2de2c1-c467-4f69-a03d-a18d797f31a7" released by "_delete_snapshot" :: held 1.609s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-quobyte-5b14ca28-67d4-474a-a14e-04ef69294f45" released by "delete_snapshot" :: held 1.639s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Created reservations ['7bec5f3a-e716-4061-bd6d-985b6b2aec7a', 'dbec3cbf-be74-49e5-8c69-6d9ccea1d664', 'a47a2c43-ec6c-4c85-8d86-e9522036be43', '265fe120-ef5d-4a0a-b39f-a75a84f55140'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Delete snapshot completed successfully.
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01d54f0e-2948-4e13-87fc-c0a6a43cc4ee tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-9a2de2c1-c467-4f69-a03d-a18d797f31a7-delete_snapshot" released by "delete_snapshot" :: held 1.808s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Acquiring lock "cinder-5b14ca28-67d4-474a-a14e-04ef69294f45-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-5b14ca28-67d4-474a-a14e-04ef69294f45-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Acquiring lock "cinder-quobyte-5b14ca28-67d4-474a-a14e-04ef69294f45" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-quobyte-5b14ca28-67d4-474a-a14e-04ef69294f45" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4927e533-ec46-4fdf-878f-43481808e6cd]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:16 devstack sudo[95526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45
Sep 06 17:03:16 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:17 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45" returned: 0 in 0.436s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:17 devstack sudo[95532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45
Sep 06 17:03:17 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:17 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5b14ca28-67d4-474a-a14e-04ef69294f45" returned: 0 in 0.282s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-quobyte-5b14ca28-67d4-474a-a14e-04ef69294f45" released by "delete_volume" :: held 0.786s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Created reservations ['bb17de78-0d90-4665-8668-2b85a9cbcac7', '163be64d-cfe1-4753-b2c0-7e72e784d534', 'c53da00f-4925-4ba2-b27f-ca71cd23805e', 'e80ebce1-1849-4a96-92f1-b08718a4c199'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:17 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:17 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:18 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.305s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:18 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Deleted volume successfully.
Sep 06 17:03:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4a6ffb2c-8b84-4937-8176-7f4455f26f71 tempest-VolumeSnapshotQuotasNegativeTestJSON-910019897 None] Lock "cinder-5b14ca28-67d4-474a-a14e-04ef69294f45-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:26 devstack sudo[95555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:26 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:26 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.415s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:03:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:03:28 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=74,cinder:SELECT=55,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:03:32 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=50,cinder:UPDATE=65,cinder:DELETE=7,cinder:INSERT=10 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Flow 'volume_create_manager' (6db54788-3420-4561-82dd-7df28fe561a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554d97b3-85f5-4eee-aa59-407641d832a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554d97b3-85f5-4eee-aa59-407641d832a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-790796806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c19f7e8e1b40c3bc138b8a0ee48d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:41Z,use_quota=True,user_id='4a73cf1f7ca34ff0a5ef55129a53d214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ecb878-2b32-453e-86ec-173bcff62d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ecb878-2b32-453e-86ec-173bcff62d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e326ac-5204-4a6e-a9a2-663598435665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e326ac-5204-4a6e-a9a2-663598435665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0', 'volume_name': 'volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6126221c-e2fb-4bb7-b967-c749e7347c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6126221c-e2fb-4bb7-b967-c749e7347c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047eb111-62eb-4051-a1bd-0ebedf0fd7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:40 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Volume 3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0', 'volume_size': 1}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-790796806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c19f7e8e1b40c3bc138b8a0ee48d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:41Z,use_quota=True,user_id='4a73cf1f7ca34ff0a5ef55129a53d214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Creating volume 3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:40 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:40 devstack sudo[95561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 1073741824
Sep 06 17:03:40 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:41 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 1073741824" returned: 0 in 0.494s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:41 devstack sudo[95568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0
Sep 06 17:03:41 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:41 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" returned: 0 in 0.297s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047eb111-62eb-4051-a1bd-0ebedf0fd7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d251b6a-fdda-4e34-aa49-d0424770f8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:41 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Volume volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 (3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0): created successfully
Sep 06 17:03:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d251b6a-fdda-4e34-aa49-d0424770f8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Flow 'volume_create_manager' (6db54788-3420-4561-82dd-7df28fe561a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-43c268d6-4eb4-4493-bfd1-80314bd59282 tempest-SnapshotDependencyTests-1185822836 None] Created volume successfully.
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Flow 'volume_create_manager' (98b237d1-5aec-48f7-b43b-dbd44592c866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031d6a0c-d3eb-45ef-a0ac-145b47f8719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031d6a0c-d3eb-45ef-a0ac-145b47f8719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1704490371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92384c3c-b3b7-4f79-8a6d-f7697f9dce4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c0c452ccba4933bb381653a4dca149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:43Z,use_quota=True,user_id='19db1b19433a4bf98ce8bfddf2d4f953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a672a46-f70a-41cf-9100-572b3ae6b77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a672a46-f70a-41cf-9100-572b3ae6b77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a608c5f1-c871-44d4-a423-2a9b7d9b1e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a608c5f1-c871-44d4-a423-2a9b7d9b1e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92384c3c-b3b7-4f79-8a6d-f7697f9dce4a', 'volume_name': 'volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c2ff4b-8ea2-47fc-93c6-98314606b448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c2ff4b-8ea2-47fc-93c6-98314606b448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a970f255-0035-4160-9bdf-20a2dd742e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:42 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Volume 92384c3c-b3b7-4f79-8a6d-f7697f9dce4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a', 'volume_size': 1}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1704490371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92384c3c-b3b7-4f79-8a6d-f7697f9dce4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c0c452ccba4933bb381653a4dca149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:43Z,use_quota=True,user_id='19db1b19433a4bf98ce8bfddf2d4f953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Creating volume 92384c3c-b3b7-4f79-8a6d-f7697f9dce4a {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:42 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:42 devstack sudo[95571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a 1073741824
Sep 06 17:03:42 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:43 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a 1073741824" returned: 0 in 0.557s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:43 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a
Sep 06 17:03:43 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:43 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a" returned: 0 in 0.291s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.582s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a970f255-0035-4160-9bdf-20a2dd742e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c02ee3-3e26-4597-bf7b-e0a138fbfe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Creating offline snapshot 74d3f54a-2baa-4c4d-beea-9f2e59871c0a of volume 3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:03:43 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Volume volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a (92384c3c-b3b7-4f79-8a6d-f7697f9dce4a): created successfully
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c02ee3-3e26-4597-bf7b-e0a138fbfe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Flow 'volume_create_manager' (98b237d1-5aec-48f7-b43b-dbd44592c866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05e91a2-24cb-49d7-9632-5b4ff7ad998d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-2637c6f5-f1cd-42b5-9b4b-f0332269d8f9 tempest-VolumesMetadataTest-1968087228 None] Created volume successfully.
Sep 06 17:03:43 devstack sudo[95581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0
Sep 06 17:03:43 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:43 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" returned: 0 in 0.386s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:44 devstack sudo[95586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a 1G
Sep 06 17:03:44 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:44 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a 1G" returned: 0 in 0.444s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:44 devstack sudo[95592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a
Sep 06 17:03:44 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:44 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a" returned: 0 in 0.328s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:44 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a is being set with open permissions: ugo+rw
Sep 06 17:03:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:44 devstack sudo[95597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a
Sep 06 17:03:44 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:45 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a" returned: 0 in 0.293s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:45 devstack sudo[95600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.info
Sep 06 17:03:45 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:45 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.info" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:45 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.info is being set with open permissions: ugo+rw
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:45 devstack sudo[95603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.info
Sep 06 17:03:45 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:45 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.info" returned: 0 in 0.294s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0dbef046-9ebc-4cc6-92f8-abbb3fdc36c9 tempest-SnapshotDependencyTests-1185822836 None] Create snapshot completed successfully
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Acquiring lock "cinder-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Lock "cinder-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Acquiring lock "cinder-quobyte-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Lock "cinder-quobyte-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e76d2ce-dbbf-4916-93d0-57708ec9f62d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:46 devstack sudo[95606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a
Sep 06 17:03:46 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:46 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a" returned: 0 in 0.396s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:46 devstack sudo[95611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a
Sep 06 17:03:46 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:46 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a" returned: 0 in 0.299s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Lock "cinder-quobyte-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a" released by "delete_volume" :: held 0.736s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Created reservations ['402e0c74-cfac-44da-a705-1c99b058c079', '919674b7-b2e4-474b-b385-965b4fb02ca6', '9978aae0-1d11-42ca-8dfe-e9bbd1a71fa7', 'fcacb1b8-58f6-4bc0-b392-4b8b6d320de3'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Flow 'volume_create_manager' (b669f0e4-02b2-4433-aa72-3b77d7d1147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da695b02-4dc1-44be-b77b-6da24c9adfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da695b02-4dc1-44be-b77b-6da24c9adfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d028cdf-1452-41ee-a948-c6ac11b9ef7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c19f7e8e1b40c3bc138b8a0ee48d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=74d3f54a-2baa-4c4d-beea-9f2e59871c0a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:47Z,use_quota=True,user_id='4a73cf1f7ca34ff0a5ef55129a53d214',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ceb2d70-ee7d-4107-94c9-eac976120aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ceb2d70-ee7d-4107-94c9-eac976120aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac99780-107f-4423-b01a-d9735946e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac99780-107f-4423-b01a-d9735946e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d028cdf-1452-41ee-a948-c6ac11b9ef7a', 'volume_name': 'volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a', 'volume_size': 1, 'snapshot_id': '74d3f54a-2baa-4c4d-beea-9f2e59871c0a'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cfebbd-7da9-4250-9e59-162bb3c8e8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cfebbd-7da9-4250-9e59-162bb3c8e8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8209ff-278c-4990-a696-23d3d71fbd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:46 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Volume 5d028cdf-1452-41ee-a948-c6ac11b9ef7a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a', 'volume_size': 1, 'snapshot_id': '74d3f54a-2baa-4c4d-beea-9f2e59871c0a'}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "cinder-quobyte-74d3f54a-2baa-4c4d-beea-9f2e59871c0a-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" by "_create_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-74d3f54a-2baa-4c4d-beea-9f2e59871c0a-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Creating volume 5d028cdf-1452-41ee-a948-c6ac11b9ef7a from snapshot 74d3f54a-2baa-4c4d-beea-9f2e59871c0a {{(pid=87474) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:46 devstack sudo[95614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:46 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "cinder-quobyte-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] snapshot: 74d3f54a-2baa-4c4d-beea-9f2e59871c0a, volume: 5d028cdf-1452-41ee-a948-c6ac11b9ef7a,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[913df522-0a16-4ece-84d6-4f83cec3d972]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:47 devstack sudo[95616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a
Sep 06 17:03:47 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:47 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.331s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:47 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Deleted volume successfully.
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-21909d84-52f5-401b-bde2-b7860336eb37 tempest-VolumesMetadataTest-1968087228 None] Lock "cinder-92384c3c-b3b7-4f79-8a6d-f7697f9dce4a-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:47 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a" returned: 0 in 0.456s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f176e807-39ab-46de-8ef0-8ef8b8ab2c80]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:47 devstack sudo[95622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0
Sep 06 17:03:47 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Flow 'volume_create_manager' (52036f50-8885-4ce6-9282-9ac722871951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee964565-ea6c-45aa-b77c-7098114b0cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:47 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" returned: 0 in 0.483s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee964565-ea6c-45aa-b77c-7098114b0cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1248440955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff48b36-1777-40dd-bbfe-d41dc0a01026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ed54d6c4d5486997b55304e92c4f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:48Z,use_quota=True,user_id='829ada56ce9b4387a1a34dd14aec61f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:48 devstack sudo[95627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a
Sep 06 17:03:48 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee19d4d-2540-4563-8c47-0380e4079f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee19d4d-2540-4563-8c47-0380e4079f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394bd197-37ca-400e-b77a-fcd66ba623c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394bd197-37ca-400e-b77a-fcd66ba623c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff48b36-1777-40dd-bbfe-d41dc0a01026', 'volume_name': 'volume-fff48b36-1777-40dd-bbfe-d41dc0a01026', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2deffc-c0b7-40af-b263-8284bc0dcd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2deffc-c0b7-40af-b263-8284bc0dcd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8244cf8c-1f69-4b3c-8a9f-2a7eb866f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:48 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Volume fff48b36-1777-40dd-bbfe-d41dc0a01026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff48b36-1777-40dd-bbfe-d41dc0a01026', 'volume_size': 1}
Sep 06 17:03:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:52 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" returned: 0 in 4.877s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:52 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:03:52 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Converted 1024.00 MB image at 209.91 MB/s
Sep 06 17:03:52 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a is being set with open permissions: ugo+rw
Sep 06 17:03:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:52 devstack sudo[95655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a
Sep 06 17:03:52 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:53 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" returned: 0 in 0.257s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" released by "_copy_volume_from_snapshot" :: held 6.191s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-74d3f54a-2baa-4c4d-beea-9f2e59871c0a-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" released by "_create_volume_from_snapshot" :: held 6.273s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.294s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.147s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1248440955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff48b36-1777-40dd-bbfe-d41dc0a01026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ed54d6c4d5486997b55304e92c4f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:48Z,use_quota=True,user_id='829ada56ce9b4387a1a34dd14aec61f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Creating volume fff48b36-1777-40dd-bbfe-d41dc0a01026 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:53 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:53 devstack sudo[95658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026 1073741824
Sep 06 17:03:53 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac8209ff-278c-4990-a696-23d3d71fbd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a', 'volume_size': 1, 'snapshot_id': '74d3f54a-2baa-4c4d-beea-9f2e59871c0a'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23522904-12aa-4291-b091-0ccf8acba553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:53 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Volume volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a (5d028cdf-1452-41ee-a948-c6ac11b9ef7a): created successfully
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23522904-12aa-4291-b091-0ccf8acba553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Flow 'volume_create_manager' (b669f0e4-02b2-4433-aa72-3b77d7d1147c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:53 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-de980064-1457-4843-b93f-3e868bc7474a tempest-SnapshotDependencyTests-1185822836 None] Created volume successfully.
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "cinder-74d3f54a-2baa-4c4d-beea-9f2e59871c0a-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-74d3f54a-2baa-4c4d-beea-9f2e59871c0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "cinder-quobyte-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "cinder-quobyte-74d3f54a-2baa-4c4d-beea-9f2e59871c0a" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-74d3f54a-2baa-4c4d-beea-9f2e59871c0a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Deleting offline snapshot 74d3f54a-2baa-4c4d-beea-9f2e59871c0a of volume 3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] snapshot_file for this snap is: volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfe61c8-4a6b-4c1d-9211-605ef5fad33a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:53 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026 1073741824" returned: 0 in 0.546s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:53 devstack sudo[95664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a
Sep 06 17:03:53 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:53 devstack sudo[95665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026
Sep 06 17:03:53 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:54 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026" returned: 0 in 0.258s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8244cf8c-1f69-4b3c-8a9f-2a7eb866f670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff48b36-1777-40dd-bbfe-d41dc0a01026', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f2bd5c-95ab-4111-b87f-c473bbf2a976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:54 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Volume volume-fff48b36-1777-40dd-bbfe-d41dc0a01026 (fff48b36-1777-40dd-bbfe-d41dc0a01026): created successfully
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90f2bd5c-95ab-4111-b87f-c473bbf2a976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Flow 'volume_create_manager' (52036f50-8885-4ce6-9282-9ac722871951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:54 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a" returned: 0 in 0.421s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:03:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-beaabf57-0995-4ed3-8816-26533c980310 tempest-VolumeQuotasAdminTestJSON-633030171 None] Created volume successfully.
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aedbf5-3d74-4efb-aab3-0632096de9ce]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:54 devstack sudo[95672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0
Sep 06 17:03:54 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:54 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" returned: 0 in 0.507s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:54 devstack sudo[95677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a
Sep 06 17:03:54 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Acquiring lock "cinder-fff48b36-1777-40dd-bbfe-d41dc0a01026-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "cinder-fff48b36-1777-40dd-bbfe-d41dc0a01026-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Acquiring lock "cinder-quobyte-fff48b36-1777-40dd-bbfe-d41dc0a01026" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "cinder-quobyte-fff48b36-1777-40dd-bbfe-d41dc0a01026" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[131a4165-01f0-497d-8829-1c9efd54d3ee]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:54 devstack sudo[95679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026
Sep 06 17:03:54 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:55 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a" returned: 0 in 0.425s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:55 devstack sudo[95684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a
Sep 06 17:03:55 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Flow 'volume_create_manager' (8e18d0b3-199b-4c37-97f9-c2d36485c396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7194cd-c664-4708-aee4-c589e6bb281e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7194cd-c664-4708-aee4-c589e6bb281e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-49003493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61b0242-b6d7-4f51-8ce1-b70f65095ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93c419368884b08b746a26a64e7926b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:55Z,use_quota=True,user_id='e6f3b756688f466abbaa9a5cc1d3e3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd439827-5289-4f87-8b62-086cb84088f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd439827-5289-4f87-8b62-086cb84088f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7409760e-6333-49e9-bc82-4f8190427a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7409760e-6333-49e9-bc82-4f8190427a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61b0242-b6d7-4f51-8ce1-b70f65095ef8', 'volume_name': 'volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602c74f7-667a-48aa-b25c-cb90c4ed0d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602c74f7-667a-48aa-b25c-cb90c4ed0d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f8f633-9c6d-43ea-bf5d-5ec11dfe4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:55 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Volume c61b0242-b6d7-4f51-8ce1-b70f65095ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8', 'volume_size': 1}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-49003493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61b0242-b6d7-4f51-8ce1-b70f65095ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93c419368884b08b746a26a64e7926b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:55Z,use_quota=True,user_id='e6f3b756688f466abbaa9a5cc1d3e3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Creating volume c61b0242-b6d7-4f51-8ce1-b70f65095ef8 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:55 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:55 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026" returned: 0 in 0.512s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:55 devstack sudo[95689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8 1073741824
Sep 06 17:03:55 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:55 devstack sudo[95690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026
Sep 06 17:03:55 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:55 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0.74d3f54a-2baa-4c4d-beea-9f2e59871c0a" returned: 0 in 0.328s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-74d3f54a-2baa-4c4d-beea-9f2e59871c0a" released by "_delete_snapshot" :: held 1.810s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" released by "delete_snapshot" :: held 1.838s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Created reservations ['9fa8eadd-6124-4ef2-ad4e-e2afa2c7179b', '30e935b0-54a7-4f66-8b75-bd1964fcfa48', 'e1cf2f0f-a5c6-4776-921b-569ca3d30a97', '3385ea83-9c22-4aa9-9993-72e976091a62'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:55 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-fff48b36-1777-40dd-bbfe-d41dc0a01026" returned: 0 in 0.272s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "cinder-quobyte-fff48b36-1777-40dd-bbfe-d41dc0a01026" released by "delete_volume" :: held 0.846s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Delete snapshot completed successfully.
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-62158f84-076e-44c3-8161-cf15f6a7af71 tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-74d3f54a-2baa-4c4d-beea-9f2e59871c0a-delete_snapshot" released by "delete_snapshot" :: held 2.052s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Created reservations ['91cc4751-dae5-4725-85f2-044029e62307', 'e6f4f645-a34c-4f0f-9b24-317d2ab50529', '54ec30ed-18b3-4af1-a558-a0126bf71b5c', '79c321d3-db2b-4a66-ab8b-407bd088242a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:55 devstack sudo[95702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:55 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "cinder-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "cinder-quobyte-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:56 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8 1073741824" returned: 0 in 0.778s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" acquired by "delete_volume" :: waited 0.113s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92b81c2-cb60-48bf-836e-f61f77737c7f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:56 devstack sudo[95720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8
Sep 06 17:03:56 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:56 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.639s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Deleted volume successfully.
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-19eda32d-d934-4a3d-a15b-cb1211ce01c7 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "cinder-fff48b36-1777-40dd-bbfe-d41dc0a01026-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:56 devstack sudo[95722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0
Sep 06 17:03:56 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:56 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8" returned: 0 in 0.440s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f8f633-9c6d-43ea-bf5d-5ec11dfe4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6596a5-b898-4e33-9697-6f2b2fda1644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:56 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Volume volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8 (c61b0242-b6d7-4f51-8ce1-b70f65095ef8): created successfully
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6596a5-b898-4e33-9697-6f2b2fda1644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Flow 'volume_create_manager' (8e18d0b3-199b-4c37-97f9-c2d36485c396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-bd75fbe5-c5d9-4cdd-b346-30557941b0aa tempest-VolumesTransfersV355Test-181789980 None] Created volume successfully.
Sep 06 17:03:57 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" returned: 0 in 0.724s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:03:57 devstack sudo[95769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0
Sep 06 17:03:57 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Flow 'volume_create_manager' (6e3a3475-a4b2-498b-b0e9-3f8e066ccca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d870fea7-ad96-46b9-ab82-f0836788585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d870fea7-ad96-46b9-ab82-f0836788585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-633643303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136a0fdf-4b51-4ba8-9a0e-ed95917b930b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ed54d6c4d5486997b55304e92c4f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:57Z,use_quota=True,user_id='829ada56ce9b4387a1a34dd14aec61f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208d823f-2102-4bea-9974-2c212767c098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (208d823f-2102-4bea-9974-2c212767c098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306b807a-5ed3-404c-8313-2a0bebd45a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306b807a-5ed3-404c-8313-2a0bebd45a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136a0fdf-4b51-4ba8-9a0e-ed95917b930b', 'volume_name': 'volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3113b7d-0752-40bc-986f-15251a20530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3113b7d-0752-40bc-986f-15251a20530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0219ce09-29ac-47bd-91e6-653a1b4dc78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:57 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Volume 136a0fdf-4b51-4ba8-9a0e-ed95917b930b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b', 'volume_size': 1}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-633643303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136a0fdf-4b51-4ba8-9a0e-ed95917b930b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ed54d6c4d5486997b55304e92c4f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:03:57Z,use_quota=True,user_id='829ada56ce9b4387a1a34dd14aec61f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Creating volume 136a0fdf-4b51-4ba8-9a0e-ed95917b930b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:03:57 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:57 devstack sudo[95771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b 1073741824
Sep 06 17:03:57 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:57 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" returned: 0 in 0.436s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0" released by "delete_volume" :: held 1.315s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Created reservations ['2654e49c-fc6e-49f4-865d-85f6dd43a5a1', '77fea554-5d8a-4143-a4bc-0bea0137357d', 'b095d51d-6ab9-4aa0-b186-9a12fb8f4ed0', '5caa3165-cfb8-49c2-9505-34e78115043a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:57 devstack sudo[95779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:57 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:57 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b 1073741824" returned: 0 in 0.649s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:57 devstack sudo[95782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b
Sep 06 17:03:57 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:58 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.394s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Deleted volume successfully.
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-80317597-154a-4724-ae45-fcdbfc34161e tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-3e6b1a9f-8df6-4041-b9ed-bec2efb5c5f0-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "cinder-5d028cdf-1452-41ee-a948-c6ac11b9ef7a-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:58 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b" returned: 0 in 0.399s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0219ce09-29ac-47bd-91e6-653a1b4dc78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00bac87-4dff-4878-8f72-7ae16027cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-5d028cdf-1452-41ee-a948-c6ac11b9ef7a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:58 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Volume volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b (136a0fdf-4b51-4ba8-9a0e-ed95917b930b): created successfully
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00bac87-4dff-4878-8f72-7ae16027cd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Flow 'volume_create_manager' (6e3a3475-a4b2-498b-b0e9-3f8e066ccca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:03:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ce154bfb-224b-43d9-9027-510efaa74f73 tempest-VolumeQuotasAdminTestJSON-633030171 None] Created volume successfully.
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "cinder-quobyte-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b807bdad-9c07-4a14-b3a6-44704b69ffa5 tempest-VolumesTransfersV355Test-1025353450 None] Transfer volume completed successfully.
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9054626b-9fd0-4438-af5a-acc3de3f9b16]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:58 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a
Sep 06 17:03:58 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:58 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" returned: 0 in 0.408s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:59 devstack sudo[95793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a
Sep 06 17:03:59 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Acquiring lock "cinder-c61b0242-b6d7-4f51-8ce1-b70f65095ef8-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Lock "cinder-c61b0242-b6d7-4f51-8ce1-b70f65095ef8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:59 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" returned: 0 in 0.291s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Acquiring lock "cinder-quobyte-c61b0242-b6d7-4f51-8ce1-b70f65095ef8" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-quobyte-5d028cdf-1452-41ee-a948-c6ac11b9ef7a" released by "delete_volume" :: held 0.762s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Lock "cinder-quobyte-c61b0242-b6d7-4f51-8ce1-b70f65095ef8" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e88c1e-cc7a-4e9c-97cd-d9ae54dfad14]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Created reservations ['4ca779cb-b718-41c8-83f2-2216b773a342', 'bd1388c7-304a-44fb-aecf-864585ddb478', 'e6fe2fb0-d029-4afd-844c-3434591f0b07', '5eb1869c-f690-477d-9e22-7b8f8edc7b02'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:59 devstack sudo[95796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8
Sep 06 17:03:59 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:59 devstack sudo[95797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:03:59 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:59 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8" returned: 0 in 0.566s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:03:59 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.466s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:03:59 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Deleted volume successfully.
Sep 06 17:03:59 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8
Sep 06 17:03:59 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:03:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9b47afe9-0809-4d08-a5cf-1043c9d0e66b tempest-SnapshotDependencyTests-1185822836 None] Lock "cinder-5d028cdf-1452-41ee-a948-c6ac11b9ef7a-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8ae45ba0-8b32-4f73-8354-b4ffdd0fe29b tempest-VolumeQuotasAdminTestJSON-249186615 None] Transfer volume completed successfully.
Sep 06 17:04:00 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c61b0242-b6d7-4f51-8ce1-b70f65095ef8" returned: 0 in 0.366s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Lock "cinder-quobyte-c61b0242-b6d7-4f51-8ce1-b70f65095ef8" released by "delete_volume" :: held 0.998s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Created reservations ['bda513a5-8340-4a73-8c92-b13893ba8f47', 'd673f03c-0865-4c92-97c8-b78c2dd4763e', '4754b19b-3ce6-4fcd-b89e-ad28b34139ba', '326cca8f-6c57-47c8-8964-6f6ace9dc222'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:00 devstack sudo[95807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:00 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Acquiring lock "cinder-136a0fdf-4b51-4ba8-9a0e-ed95917b930b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Lock "cinder-136a0fdf-4b51-4ba8-9a0e-ed95917b930b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Acquiring lock "cinder-quobyte-136a0fdf-4b51-4ba8-9a0e-ed95917b930b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Lock "cinder-quobyte-136a0fdf-4b51-4ba8-9a0e-ed95917b930b" acquired by "delete_volume" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ab3a7-129b-41b0-b277-6424ae68861d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:00 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.452s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:00 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Deleted volume successfully.
Sep 06 17:04:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-65558aa4-5569-47b0-94be-f33b07847502 tempest-VolumesTransfersV355Test-1900247 None] Lock "cinder-c61b0242-b6d7-4f51-8ce1-b70f65095ef8-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:01 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b
Sep 06 17:04:01 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:01 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b" returned: 0 in 0.577s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:01 devstack sudo[95816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b
Sep 06 17:04:01 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:01 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-136a0fdf-4b51-4ba8-9a0e-ed95917b930b" returned: 0 in 0.373s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Lock "cinder-quobyte-136a0fdf-4b51-4ba8-9a0e-ed95917b930b" released by "delete_volume" :: held 1.039s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Created reservations ['5f8f3557-678d-4391-8ef2-ca519aec204c', '6f981427-4ba2-4d9a-9492-f82f7c27c5d1', 'ecd3b9ad-1cb9-474c-bcb9-291ae2098cad', '57c8583d-14f0-4741-b9cd-2595e4a29aa9'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:02 devstack sudo[95819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:02 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Flow 'volume_create_manager' (3e47d8a3-39a6-48fe-9191-a9d0e5e4ff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c9dcc-61c8-469e-b3a8-29a89a512ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35c9dcc-61c8-469e-b3a8-29a89a512ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1049094131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278a92fa-f8d2-413b-b803-0ccd7c873c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93c419368884b08b746a26a64e7926b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:02Z,use_quota=True,user_id='e6f3b756688f466abbaa9a5cc1d3e3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c219ca0a-bbe3-4dfe-9649-280b571abd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c219ca0a-bbe3-4dfe-9649-280b571abd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda92ad4-d152-474a-ac1d-db6c74ef8447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda92ad4-d152-474a-ac1d-db6c74ef8447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '278a92fa-f8d2-413b-b803-0ccd7c873c1b', 'volume_name': 'volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f308f3ec-5e93-4b7a-9c60-d187f30aa462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f308f3ec-5e93-4b7a-9c60-d187f30aa462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2dd4e4-167a-4b5f-b66a-716c5f4e723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Volume 278a92fa-f8d2-413b-b803-0ccd7c873c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b', 'volume_size': 1}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1049094131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=278a92fa-f8d2-413b-b803-0ccd7c873c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f93c419368884b08b746a26a64e7926b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:02Z,use_quota=True,user_id='e6f3b756688f466abbaa9a5cc1d3e3c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Creating volume 278a92fa-f8d2-413b-b803-0ccd7c873c1b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:02 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:02 devstack sudo[95822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b 1073741824
Sep 06 17:04:02 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:02 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.469s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:02 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Deleted volume successfully.
Sep 06 17:04:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a6ac42a5-527d-4168-9c1a-73292a86c4ec tempest-VolumeQuotasAdminTestJSON-1571039503 None] Lock "cinder-136a0fdf-4b51-4ba8-9a0e-ed95917b930b-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:03 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b 1073741824" returned: 0 in 0.667s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:03 devstack sudo[95830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b
Sep 06 17:04:03 devstack sudo[95830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:03 devstack sudo[95830]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b" returned: 0 in 0.305s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2dd4e4-167a-4b5f-b66a-716c5f4e723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c0d64a-52f6-410e-bc0a-e4abc20fb3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:03 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Volume volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b (278a92fa-f8d2-413b-b803-0ccd7c873c1b): created successfully
Sep 06 17:04:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c0d64a-52f6-410e-bc0a-e4abc20fb3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Flow 'volume_create_manager' (3e47d8a3-39a6-48fe-9191-a9d0e5e4ff6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:03 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-10c4b1f3-40a1-4818-a1e9-399940b32bc9 tempest-VolumesTransfersV355Test-181789980 None] Created volume successfully.
Sep 06 17:04:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Acquiring lock "cinder-278a92fa-f8d2-413b-b803-0ccd7c873c1b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Lock "cinder-278a92fa-f8d2-413b-b803-0ccd7c873c1b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Acquiring lock "cinder-quobyte-278a92fa-f8d2-413b-b803-0ccd7c873c1b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Lock "cinder-quobyte-278a92fa-f8d2-413b-b803-0ccd7c873c1b" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:04 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb5251a-4324-4686-942e-cb2beb5db8b9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:05 devstack sudo[95833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b
Sep 06 17:04:05 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:05 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b" returned: 0 in 0.529s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:05 devstack sudo[95838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b
Sep 06 17:04:05 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:05 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-278a92fa-f8d2-413b-b803-0ccd7c873c1b" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Lock "cinder-quobyte-278a92fa-f8d2-413b-b803-0ccd7c873c1b" released by "delete_volume" :: held 0.926s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Created reservations ['b1064ef5-157a-4b87-8435-bb8651da6ad2', '5ea33f35-37f1-498e-a9c3-bcb23aa2fc54', 'dfb73271-bcc1-4794-8926-c1bfe59029e3', 'ba406d42-8f06-442b-a594-12d6294417df'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:05 devstack sudo[95844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:05 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:06 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.376s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:06 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Deleted volume successfully.
Sep 06 17:04:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-31afa48a-3c17-463f-977a-824b4b47e7d8 tempest-VolumesTransfersV355Test-1900247 None] Lock "cinder-278a92fa-f8d2-413b-b803-0ccd7c873c1b-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:15 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=63,cinder:UPDATE=83,cinder:DELETE=7,cinder:INSERT=22 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:04:16 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=85,cinder:INSERT=18,cinder:SELECT=58,cinder:DELETE=8 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Flow 'volume_create_manager' (90008b79-0f32-4987-83e8-52eed84c0791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8471b4be-462c-490f-a17e-ca2da8646b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8471b4be-462c-490f-a17e-ca2da8646b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-487065840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f148091-56ff-4ffb-bcd5-a9719fdc9fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bdd5191bec4495b8ec59ce7d0586e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:18Z,use_quota=True,user_id='38c35f231603465aaf03006b9ec64930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6000eb4-f132-4a73-a7fa-7fdd97476e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6000eb4-f132-4a73-a7fa-7fdd97476e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74beb48-30d9-4972-89e0-dc1948ca8a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74beb48-30d9-4972-89e0-dc1948ca8a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f148091-56ff-4ffb-bcd5-a9719fdc9fc0', 'volume_name': 'volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4547e936-e47a-4f8b-8c81-9b152a97dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4547e936-e47a-4f8b-8c81-9b152a97dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a108fe-f846-4f9b-8367-1acc5860770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:17 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Volume 5f148091-56ff-4ffb-bcd5-a9719fdc9fc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0', 'volume_size': 1}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-487065840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f148091-56ff-4ffb-bcd5-a9719fdc9fc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bdd5191bec4495b8ec59ce7d0586e9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:18Z,use_quota=True,user_id='38c35f231603465aaf03006b9ec64930',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Creating volume 5f148091-56ff-4ffb-bcd5-a9719fdc9fc0 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:17 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:17 devstack sudo[95938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0 1073741824
Sep 06 17:04:17 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:18 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0 1073741824" returned: 0 in 0.562s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:18 devstack sudo[95951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0
Sep 06 17:04:18 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:18 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0" returned: 0 in 0.314s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a108fe-f846-4f9b-8367-1acc5860770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0654fc1b-aa57-45b2-974c-eb0a85b037d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:18 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Volume volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0 (5f148091-56ff-4ffb-bcd5-a9719fdc9fc0): created successfully
Sep 06 17:04:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0654fc1b-aa57-45b2-974c-eb0a85b037d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Flow 'volume_create_manager' (90008b79-0f32-4987-83e8-52eed84c0791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ed2ea0d7-d16b-4f87-87be-489758e18f39 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Created volume successfully.
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Flow 'volume_create_manager' (b95c06ec-a158-474e-9768-2f36161818c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b92d57-8a1c-4fd8-ab20-7727ed0131c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b92d57-8a1c-4fd8-ab20-7727ed0131c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-414521625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57924a2c-3338-4505-af59-969c8826ab51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2331cc591284994892c0666299686ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:20Z,use_quota=True,user_id='a7dbf6925d564b23bf95dcac0539ab44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a8b56e-8955-4cc6-b045-749dc39e75ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a8b56e-8955-4cc6-b045-749dc39e75ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c6c163-d945-44ec-80cb-197cc8352d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c6c163-d945-44ec-80cb-197cc8352d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57924a2c-3338-4505-af59-969c8826ab51', 'volume_name': 'volume-57924a2c-3338-4505-af59-969c8826ab51', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008da68a0>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1210b5f-9e0f-4e0f-9ade-434479c59b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1210b5f-9e0f-4e0f-9ade-434479c59b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb39069e-b2f3-4b53-b245-b3dbf5c31739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Volume 57924a2c-3338-4505-af59-969c8826ab51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57924a2c-3338-4505-af59-969c8826ab51', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008da68a0>}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Trying to clone 57924a2c-3338-4505-af59-969c8826ab51 from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Acquiring lock "cinder-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "cinder-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Acquiring lock "cinder-quobyte-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "cinder-quobyte-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0" acquired by "delete_volume" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[66198c7e-3423-4416-bc1f-0dd960d1921d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:20 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:04:20 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Image download 20.69 MB at 20.69 MB/s
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b8cb6b-4021-4318-ba5c-2f86a6591c0f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:21 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0
Sep 06 17:04:21 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:21 devstack sudo[95956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD
Sep 06 17:04:21 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:21 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0" returned: 0 in 0.411s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:21 devstack sudo[95963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0
Sep 06 17:04:21 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:21 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf is fetched for user a7dbf6925d564b23bf95dcac0539ab44. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7b0372-9536-4aef-9c9b-be6b291dc8a5]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:21 devstack sudo[95968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD
Sep 06 17:04:21 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:21 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0" returned: 0 in 0.289s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "cinder-quobyte-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0" released by "delete_volume" :: held 0.750s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Created reservations ['38a993eb-3221-454e-9c42-2709e0846d5c', '64d0f44b-b42f-4cd7-a3f6-a83b2d21d44c', 'd39125b8-8a46-4b7f-ac6a-4ae86968f026', 'a3e234ca-fb40-4f54-8247-af2a1c0ad88e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:21 devstack sudo[95971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:21 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:21 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-414521625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57924a2c-3338-4505-af59-969c8826ab51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2331cc591284994892c0666299686ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:20Z,use_quota=True,user_id='a7dbf6925d564b23bf95dcac0539ab44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Creating volume 57924a2c-3338-4505-af59-969c8826ab51 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:21 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:21 devstack sudo[95976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 1073741824
Sep 06 17:04:21 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:22 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.338s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Deleted volume successfully.
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-89428b50-a65a-40f8-bf35-e201fd4619a1 tempest-VolumeQuotasNegativeTestJSON-2060488203 None] Lock "cinder-5f148091-56ff-4ffb-bcd5-a9719fdc9fc0-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:22 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 1073741824" returned: 0 in 0.527s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:22 devstack sudo[95983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51
Sep 06 17:04:22 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:22 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Attempting download of 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume 57924a2c-3338-4505-af59-969c8826ab51. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd43d4e-e79c-4219-b929-c26762a94388]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_c6u46plc {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:23 devstack sudo[95986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_c6u46plc
Sep 06 17:04:23 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:23 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_c6u46plc" returned: 0 in 0.434s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_c6u46plc {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:23 devstack sudo[95990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_c6u46plc
Sep 06 17:04:23 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:23 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_c6u46plc" returned: 1 in 0.384s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_c6u46plc' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:04:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f529d2d-760c-438d-9cf1-42fcaef03ff7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:23 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD
Sep 06 17:04:23 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:24 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:24 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] 23f4b67c-17a9-402c-a0ff-7560fceb54cf was qcow2, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:04:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:24 devstack sudo[95999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51
Sep 06 17:04:24 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:26 devstack sudo[96015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:26 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:26 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51" returned: 0 in 2.110s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_kpb1_81idevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:04:26 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Converted 112.00 MB image at 53.04 MB/s
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:26 devstack sudo[96017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 1G
Sep 06 17:04:26 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:26 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:04:26 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 1G" returned: 0 in 0.491s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Downloaded image 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume 57924a2c-3338-4505-af59-969c8826ab51 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf for user a7dbf6925d564b23bf95dcac0539ab44 is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Marking volume 57924a2c-3338-4505-af59-969c8826ab51 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Copying metadata from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf to 57924a2c-3338-4505-af59-969c8826ab51. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Creating volume glance metadata for volume 57924a2c-3338-4505-af59-969c8826ab51 backed by image 23f4b67c-17a9-402c-a0ff-7560fceb54cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb39069e-b2f3-4b53-b245-b3dbf5c31739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57924a2c-3338-4505-af59-969c8826ab51', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008da68a0>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0165a017-07f9-4e33-a275-c02a8a017b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:26 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Volume volume-57924a2c-3338-4505-af59-969c8826ab51 (57924a2c-3338-4505-af59-969c8826ab51): created successfully
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0165a017-07f9-4e33-a275-c02a8a017b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Flow 'volume_create_manager' (b95c06ec-a158-474e-9768-2f36161818c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:26 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-67371d1a-b8d2-4e61-8bc0-bec9449ff0a9 tempest-VolumesExtendTest-1101104940 None] Created volume successfully.
Sep 06 17:04:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ddb75e48-84ca-499f-8393-567b1d44020a tempest-VolumesExtendTest-1101104940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ddb75e48-84ca-499f-8393-567b1d44020a tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b83aca-6628-48d7-8e9d-8019b69ee036]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddb75e48-84ca-499f-8393-567b1d44020a tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:27 devstack sudo[96056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51
Sep 06 17:04:27 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:28 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddb75e48-84ca-499f-8393-567b1d44020a tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51" returned: 0 in 0.395s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddb75e48-84ca-499f-8393-567b1d44020a tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 2G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddb75e48-84ca-499f-8393-567b1d44020a tempest-VolumesExtendTest-1101104940 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 2G" returned: 0 in 0.097s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ddb75e48-84ca-499f-8393-567b1d44020a tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.517s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:28 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ddb75e48-84ca-499f-8393-567b1d44020a tempest-VolumesExtendTest-1101104940 None] Extend volume completed successfully.
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Acquiring lock "cinder-57924a2c-3338-4505-af59-969c8826ab51-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Lock "cinder-57924a2c-3338-4505-af59-969c8826ab51-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Acquiring lock "cinder-quobyte-57924a2c-3338-4505-af59-969c8826ab51" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Lock "cinder-quobyte-57924a2c-3338-4505-af59-969c8826ab51" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[093ecfce-88d9-4cc9-b052-af09f983417a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:29 devstack sudo[96065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51
Sep 06 17:04:29 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Flow 'volume_create_manager' (157f846d-80f3-4f79-a3f5-22a22f94e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96f289a-246e-482e-a527-c584f2845eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96f289a-246e-482e-a527-c584f2845eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-727234970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb17070-d3e9-40d0-a925-16f7af1f139d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aaa11340d914c36b8bf412357a106a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:29Z,use_quota=True,user_id='5f50592e2b7542acbd879f16e84515e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230028dc-57f6-43e1-9d9f-9d0cfc103787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (230028dc-57f6-43e1-9d9f-9d0cfc103787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b99249a-1948-43ad-a62d-2db501f81b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b99249a-1948-43ad-a62d-2db501f81b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb17070-d3e9-40d0-a925-16f7af1f139d', 'volume_name': 'volume-cfb17070-d3e9-40d0-a925-16f7af1f139d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b782458c-6fc9-4349-82a7-4a6d4c51cfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b782458c-6fc9-4349-82a7-4a6d4c51cfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbdce15-33a5-44c7-97e4-45e1db4f7073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:29 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Volume cfb17070-d3e9-40d0-a925-16f7af1f139d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb17070-d3e9-40d0-a925-16f7af1f139d', 'volume_size': 1}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-727234970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb17070-d3e9-40d0-a925-16f7af1f139d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aaa11340d914c36b8bf412357a106a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:29Z,use_quota=True,user_id='5f50592e2b7542acbd879f16e84515e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Creating volume cfb17070-d3e9-40d0-a925-16f7af1f139d {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:29 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:29 devstack sudo[96067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d 1073741824
Sep 06 17:04:29 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:29 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51" returned: 0 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:29 devstack sudo[96072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51
Sep 06 17:04:29 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:29 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57924a2c-3338-4505-af59-969c8826ab51" returned: 0 in 0.247s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Lock "cinder-quobyte-57924a2c-3338-4505-af59-969c8826ab51" released by "delete_volume" :: held 0.644s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:30 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d 1073741824" returned: 0 in 0.431s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Created reservations ['052a69e7-101a-4cb4-8b8a-a27f6ac0d343', '9ab6353d-edef-4c3c-9d54-bc1192c49686', 'fccd6438-cae3-4013-8fa4-c91085e4e119', 'bded6863-d06b-4925-9de3-1c168626fe07'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:30 devstack sudo[96078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d
Sep 06 17:04:30 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:30 devstack sudo[96080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:30 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:30 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbdce15-33a5-44c7-97e4-45e1db4f7073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb17070-d3e9-40d0-a925-16f7af1f139d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df47047-bdda-4980-8b2a-36b70b74f0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:30 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Volume volume-cfb17070-d3e9-40d0-a925-16f7af1f139d (cfb17070-d3e9-40d0-a925-16f7af1f139d): created successfully
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df47047-bdda-4980-8b2a-36b70b74f0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Flow 'volume_create_manager' (157f846d-80f3-4f79-a3f5-22a22f94e770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:30 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.249s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:30 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-68c67f36-82cf-4e77-a57b-50b0f2b8f140 tempest-VolumesServicesTestJSON-426360689 None] Created volume successfully.
Sep 06 17:04:30 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Deleted volume successfully.
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-03227c87-4455-4a31-a1e4-719d4fd2d72f tempest-VolumesExtendTest-1101104940 None] Lock "cinder-57924a2c-3338-4505-af59-969c8826ab51-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Acquiring lock "cinder-cfb17070-d3e9-40d0-a925-16f7af1f139d-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Lock "cinder-cfb17070-d3e9-40d0-a925-16f7af1f139d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Acquiring lock "cinder-quobyte-cfb17070-d3e9-40d0-a925-16f7af1f139d" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Lock "cinder-quobyte-cfb17070-d3e9-40d0-a925-16f7af1f139d" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e52710f-7d7f-40bd-bd9c-1d10bcc1db3d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:30 devstack sudo[96084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d
Sep 06 17:04:30 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Flow 'volume_create_manager' (94032abf-7db9-4271-99d3-61387876d24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2065dd-27fb-4e57-a61a-e853c553d7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2065dd-27fb-4e57-a61a-e853c553d7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1731796935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f95b84-98a2-4106-ace2-0b1d550caab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2331cc591284994892c0666299686ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:31Z,use_quota=True,user_id='a7dbf6925d564b23bf95dcac0539ab44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e39887b-a204-4807-8e11-a8f1cca225bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e39887b-a204-4807-8e11-a8f1cca225bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df5c3e7-3dd9-4508-9d4a-cef4508140bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df5c3e7-3dd9-4508-9d4a-cef4508140bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f95b84-98a2-4106-ace2-0b1d550caab5', 'volume_name': 'volume-35f95b84-98a2-4106-ace2-0b1d550caab5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3705aceb-224c-465d-afd5-05bc1eadd540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3705aceb-224c-465d-afd5-05bc1eadd540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29be527c-5cf4-4167-afac-5f6cc02ff915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:31 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Volume 35f95b84-98a2-4106-ace2-0b1d550caab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f95b84-98a2-4106-ace2-0b1d550caab5', 'volume_size': 1}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1731796935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f95b84-98a2-4106-ace2-0b1d550caab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2331cc591284994892c0666299686ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:31Z,use_quota=True,user_id='a7dbf6925d564b23bf95dcac0539ab44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Creating volume 35f95b84-98a2-4106-ace2-0b1d550caab5 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:31 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:31 devstack sudo[96086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5 1073741824
Sep 06 17:04:31 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:31 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d" returned: 0 in 0.390s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:31 devstack sudo[96091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d
Sep 06 17:04:31 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:31 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5 1073741824" returned: 0 in 0.410s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:31 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-cfb17070-d3e9-40d0-a925-16f7af1f139d" returned: 0 in 0.297s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Lock "cinder-quobyte-cfb17070-d3e9-40d0-a925-16f7af1f139d" released by "delete_volume" :: held 0.737s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:31 devstack sudo[96098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5
Sep 06 17:04:31 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Created reservations ['55f3818f-679b-498e-8180-54c8f7aaeecd', 'c6c07d59-eb53-4264-b4d7-6adba3f69107', '82de1562-d642-4a39-a2b4-9d5a1daa2c38', '1cefc301-df93-44b5-83de-690474c2a951'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:31 devstack sudo[96100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:31 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:31 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5" returned: 0 in 0.265s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29be527c-5cf4-4167-afac-5f6cc02ff915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f95b84-98a2-4106-ace2-0b1d550caab5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d31f6b5-9582-478d-8817-530380e59950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:31 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Volume volume-35f95b84-98a2-4106-ace2-0b1d550caab5 (35f95b84-98a2-4106-ace2-0b1d550caab5): created successfully
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d31f6b5-9582-478d-8817-530380e59950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Flow 'volume_create_manager' (94032abf-7db9-4271-99d3-61387876d24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:31 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b85b3d79-fa78-4baa-8909-7b11f9423849 tempest-VolumesExtendTest-1101104940 None] Created volume successfully.
Sep 06 17:04:31 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.279s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:31 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Deleted volume successfully.
Sep 06 17:04:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-01c2f651-89f2-44b7-9715-4b13fca211ce tempest-VolumesServicesTestJSON-426360689 None] Lock "cinder-cfb17070-d3e9-40d0-a925-16f7af1f139d-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Creating offline snapshot 0caca1cd-748e-4e05-bf51-860b25fd9be5 of volume 35f95b84-98a2-4106-ace2-0b1d550caab5 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:04:32 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86ef071-1f35-453f-ae90-89474fa8b09b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:32 devstack sudo[96104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5
Sep 06 17:04:32 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:32 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5" returned: 0 in 0.363s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:32 devstack sudo[96109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 1G
Sep 06 17:04:32 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:33 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 1G" returned: 0 in 0.422s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f95b84-98a2-4106-ace2-0b1d550caab5 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:33 devstack sudo[96114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f95b84-98a2-4106-ace2-0b1d550caab5 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5
Sep 06 17:04:33 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:33 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35f95b84-98a2-4106-ace2-0b1d550caab5 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5" returned: 0 in 0.360s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:33 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 is being set with open permissions: ugo+rw
Sep 06 17:04:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:33 devstack sudo[96119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5
Sep 06 17:04:33 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:33 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5" returned: 0 in 0.267s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:33 devstack sudo[96122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.info
Sep 06 17:04:33 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:33 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.info" returned: 0 in 0.275s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:33 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.info is being set with open permissions: ugo+rw
Sep 06 17:04:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:34 devstack sudo[96125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.info
Sep 06 17:04:34 devstack sudo[96125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:34 devstack sudo[96125]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.info" returned: 0 in 0.308s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0f17260f-91da-4393-bd8a-0485d2ec2c8f tempest-VolumesExtendTest-1101104940 None] Create snapshot completed successfully
Sep 06 17:04:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1a028e4-2b45-4baa-8dc4-153407891f26 tempest-VolumesExtendTest-1101104940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1a028e4-2b45-4baa-8dc4-153407891f26 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:35 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b6e03f-1b69-4561-8621-d9ef2a33d97b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1a028e4-2b45-4baa-8dc4-153407891f26 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:35 devstack sudo[96128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5
Sep 06 17:04:35 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:35 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1a028e4-2b45-4baa-8dc4-153407891f26 tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5" returned: 0 in 0.375s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1a028e4-2b45-4baa-8dc4-153407891f26 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 2G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1a028e4-2b45-4baa-8dc4-153407891f26 tempest-VolumesExtendTest-1101104940 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 2G" returned: 0 in 0.119s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1a028e4-2b45-4baa-8dc4-153407891f26 tempest-VolumesExtendTest-1101104940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.530s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f1a028e4-2b45-4baa-8dc4-153407891f26 tempest-VolumesExtendTest-1101104940 None] Extend volume completed successfully.
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Acquiring lock "cinder-0caca1cd-748e-4e05-bf51-860b25fd9be5-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Lock "cinder-0caca1cd-748e-4e05-bf51-860b25fd9be5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Acquiring lock "cinder-quobyte-35f95b84-98a2-4106-ace2-0b1d550caab5" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Lock "cinder-quobyte-35f95b84-98a2-4106-ace2-0b1d550caab5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Acquiring lock "cinder-quobyte-0caca1cd-748e-4e05-bf51-860b25fd9be5" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Lock "cinder-quobyte-0caca1cd-748e-4e05-bf51-860b25fd9be5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Deleting offline snapshot 0caca1cd-748e-4e05-bf51-860b25fd9be5 of volume 35f95b84-98a2-4106-ace2-0b1d550caab5 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] snapshot_file for this snap is: volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[568276f2-6f90-409b-bc7a-8fee4b655d17]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:36 devstack sudo[96137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5
Sep 06 17:04:36 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:37 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35f95b84-98a2-4106-ace2-0b1d550caab5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[65973304-dc93-48a7-9a0c-2764a525f051]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:37 devstack sudo[96143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5
Sep 06 17:04:37 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:37 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5" returned: 0 in 0.378s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:37 devstack sudo[96148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5
Sep 06 17:04:37 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Flow 'volume_create_manager' (15b6bc30-2959-4b90-8f74-045ba6a273d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da3f2b8-3a6a-4f1c-af72-cfc80023a8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da3f2b8-3a6a-4f1c-af72-cfc80023a8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-783756424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae6483b-83ff-4e09-b5eb-6a67d34fa20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18aafaf961594009b479a1f8b53a1421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:38Z,use_quota=True,user_id='50cc99bb74604ff4bf60354d2ffc6d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb44eb4-2e35-4d2f-b125-ab299b12146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb44eb4-2e35-4d2f-b125-ab299b12146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c4735b-04b5-4cb2-9fdc-4d50d1d8adf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c4735b-04b5-4cb2-9fdc-4d50d1d8adf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae6483b-83ff-4e09-b5eb-6a67d34fa20b', 'volume_name': 'volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99aa6a51-83e8-42b5-a381-9fa20024f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99aa6a51-83e8-42b5-a381-9fa20024f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e60c7f6-d2e3-4946-8d71-8ce8131afe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:37 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Volume 5ae6483b-83ff-4e09-b5eb-6a67d34fa20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b', 'volume_size': 1}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-783756424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae6483b-83ff-4e09-b5eb-6a67d34fa20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18aafaf961594009b479a1f8b53a1421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:38Z,use_quota=True,user_id='50cc99bb74604ff4bf60354d2ffc6d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Creating volume 5ae6483b-83ff-4e09-b5eb-6a67d34fa20b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:37 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:37 devstack sudo[96153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b 1073741824
Sep 06 17:04:37 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:37 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5" returned: 0 in 0.348s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:37 devstack sudo[96156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5
Sep 06 17:04:37 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:38 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5.0caca1cd-748e-4e05-bf51-860b25fd9be5" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Lock "cinder-quobyte-0caca1cd-748e-4e05-bf51-860b25fd9be5" released by "_delete_snapshot" :: held 1.465s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Lock "cinder-quobyte-35f95b84-98a2-4106-ace2-0b1d550caab5" released by "delete_snapshot" :: held 1.487s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:38 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b 1073741824" returned: 0 in 0.459s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Created reservations ['cfd275d1-e762-4516-9e58-780aeaf66f8d', '7c000307-52f0-4e70-a3ad-c55745a20bb1', 'e7498704-3d24-4b4e-afec-f9c75ddc79e4', '0fdc8484-2f5d-4bd3-b792-e557f27d5f34'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:38 devstack sudo[96164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b
Sep 06 17:04:38 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Delete snapshot completed successfully.
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e29f0af5-ec6b-41e8-b359-2f148207fca9 tempest-VolumesExtendTest-1101104940 None] Lock "cinder-0caca1cd-748e-4e05-bf51-860b25fd9be5-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:38 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b" returned: 0 in 0.274s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e60c7f6-d2e3-4946-8d71-8ce8131afe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a647636-ff1e-40b1-9754-6dced0ce9156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:38 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Volume volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b (5ae6483b-83ff-4e09-b5eb-6a67d34fa20b): created successfully
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a647636-ff1e-40b1-9754-6dced0ce9156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Flow 'volume_create_manager' (15b6bc30-2959-4b90-8f74-045ba6a273d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-055ead75-b10a-4963-a653-1b65260dc921 tempest-VolumesListAdminTestJSON-1123472916 None] Created volume successfully.
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Flow 'volume_create_manager' (5b330b17-8340-4e8e-81ad-8d6cbbeb8d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d61a35b-5078-4cbe-bf12-7505c17f0335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d61a35b-5078-4cbe-bf12-7505c17f0335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-767331355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6750f848-3c91-46c1-9294-361cc04dad05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383c492582234c45a975f2f668d38fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:39Z,use_quota=True,user_id='bab2f2b3c5044b17a1ed6eda3f2d2aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcfb25f-91c0-4f3d-a82b-cdb10da9689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcfb25f-91c0-4f3d-a82b-cdb10da9689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd6257a-a9be-4909-9cfb-32c465bddf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd6257a-a9be-4909-9cfb-32c465bddf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6750f848-3c91-46c1-9294-361cc04dad05', 'volume_name': 'volume-6750f848-3c91-46c1-9294-361cc04dad05', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5607b9b-5547-4078-bb05-8d80938494bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5607b9b-5547-4078-bb05-8d80938494bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b93d00f-3ee1-4cf7-90f2-f28cc4b63c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:38 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Volume 6750f848-3c91-46c1-9294-361cc04dad05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6750f848-3c91-46c1-9294-361cc04dad05', 'volume_size': 1}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-767331355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6750f848-3c91-46c1-9294-361cc04dad05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383c492582234c45a975f2f668d38fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:39Z,use_quota=True,user_id='bab2f2b3c5044b17a1ed6eda3f2d2aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Creating volume 6750f848-3c91-46c1-9294-361cc04dad05 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:38 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:38 devstack sudo[96167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05 1073741824
Sep 06 17:04:38 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Acquiring lock "cinder-35f95b84-98a2-4106-ace2-0b1d550caab5-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Lock "cinder-35f95b84-98a2-4106-ace2-0b1d550caab5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Acquiring lock "cinder-quobyte-35f95b84-98a2-4106-ace2-0b1d550caab5" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Lock "cinder-quobyte-35f95b84-98a2-4106-ace2-0b1d550caab5" acquired by "delete_volume" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1b4b0b-4bac-404d-8aad-a93bbaa6d6d6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:39 devstack sudo[96172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5
Sep 06 17:04:39 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:39 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05 1073741824" returned: 0 in 0.426s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:39 devstack sudo[96175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05
Sep 06 17:04:39 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:39 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5" returned: 0 in 0.352s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:39 devstack sudo[96180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5
Sep 06 17:04:39 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:39 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05" returned: 0 in 0.241s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b93d00f-3ee1-4cf7-90f2-f28cc4b63c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6750f848-3c91-46c1-9294-361cc04dad05', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec292e32-8e75-4a36-b939-917879253da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:39 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Volume volume-6750f848-3c91-46c1-9294-361cc04dad05 (6750f848-3c91-46c1-9294-361cc04dad05): created successfully
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec292e32-8e75-4a36-b939-917879253da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Flow 'volume_create_manager' (5b330b17-8340-4e8e-81ad-8d6cbbeb8d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:39 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5831467e-9c96-45fe-8c0a-c7c6e1766de3 tempest-AttachVolumeNegativeTest-543811115 None] Created volume successfully.
Sep 06 17:04:39 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-35f95b84-98a2-4106-ace2-0b1d550caab5" returned: 0 in 0.241s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Lock "cinder-quobyte-35f95b84-98a2-4106-ace2-0b1d550caab5" released by "delete_volume" :: held 0.653s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Created reservations ['e4c67970-d1f2-4696-81cb-1a7176c1ad0d', '23540105-72d8-44df-a0f9-4385c72adc5a', '30256bd5-9b2f-4f05-8ed8-7e86705de74a', 'e963f742-6661-4b89-9ee5-629618a027ed'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:39 devstack sudo[96184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:39 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:40 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Deleted volume successfully.
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-33ddb97d-c041-4874-93fe-8a6dc8c7db1a tempest-VolumesExtendTest-1101104940 None] Lock "cinder-35f95b84-98a2-4106-ace2-0b1d550caab5-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Flow 'volume_create_manager' (7fe6f06f-7407-4205-8edb-f3407b4c5c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24bedf1-e5f5-4e4a-af99-5cf2063687bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24bedf1-e5f5-4e4a-af99-5cf2063687bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-243110937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be266d61-d72f-4b7d-baf1-2b1d5d838af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18aafaf961594009b479a1f8b53a1421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:40Z,use_quota=True,user_id='50cc99bb74604ff4bf60354d2ffc6d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d6304d-6b2d-4ba8-80df-87cbb3316782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d6304d-6b2d-4ba8-80df-87cbb3316782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c548f4ac-90fc-4659-9da9-68c7a4cacde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c548f4ac-90fc-4659-9da9-68c7a4cacde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be266d61-d72f-4b7d-baf1-2b1d5d838af3', 'volume_name': 'volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f32767-ed4f-4502-9bcc-02a7f8d44344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f32767-ed4f-4502-9bcc-02a7f8d44344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013862e1-9ec4-4654-b775-973dd6940ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:40 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Volume be266d61-d72f-4b7d-baf1-2b1d5d838af3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3', 'volume_size': 1}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-243110937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be266d61-d72f-4b7d-baf1-2b1d5d838af3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18aafaf961594009b479a1f8b53a1421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:40Z,use_quota=True,user_id='50cc99bb74604ff4bf60354d2ffc6d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Creating volume be266d61-d72f-4b7d-baf1-2b1d5d838af3 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:40 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:40 devstack sudo[96198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3 1073741824
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ed0bcf68-0e90-4f27-a13b-5076e9ed02a0 req-f3313026-568e-44ff-846f-19f7633f10f3 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:40 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:40 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3 1073741824" returned: 0 in 0.493s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:41 devstack sudo[96206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3
Sep 06 17:04:41 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:41 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3" returned: 0 in 0.279s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ed0bcf68-0e90-4f27-a13b-5076e9ed02a0 req-f3313026-568e-44ff-846f-19f7633f10f3 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.774s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013862e1-9ec4-4654-b775-973dd6940ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5476426d-07d8-4a73-84a1-353764c65c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ed0bcf68-0e90-4f27-a13b-5076e9ed02a0 req-f3313026-568e-44ff-846f-19f7633f10f3 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:41 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Volume volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3 (be266d61-d72f-4b7d-baf1-2b1d5d838af3): created successfully
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5476426d-07d8-4a73-84a1-353764c65c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Flow 'volume_create_manager' (7fe6f06f-7407-4205-8edb-f3407b4c5c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f422a921-7f7d-4e4e-ad65-eb311b501745 tempest-VolumesListAdminTestJSON-1123472916 None] Created volume successfully.
Sep 06 17:04:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ed0bcf68-0e90-4f27-a13b-5076e9ed02a0 req-f3313026-568e-44ff-846f-19f7633f10f3 tempest-AttachVolumeNegativeTest-543811115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-6750f848-3c91-46c1-9294-361cc04dad05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b662a6f-0ff6-4066-9f5a-d297e6556571', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:04:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-ed0bcf68-0e90-4f27-a13b-5076e9ed02a0 req-f3313026-568e-44ff-846f-19f7633f10f3 tempest-AttachVolumeNegativeTest-543811115 None] attachment_update completed successfully.
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Flow 'volume_create_manager' (7966590e-1a73-4923-9c9c-503b34605ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70dc59de-da38-46cd-930a-e68f0e86d142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70dc59de-da38-46cd-930a-e68f0e86d142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1302481001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18aafaf961594009b479a1f8b53a1421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:43Z,use_quota=True,user_id='50cc99bb74604ff4bf60354d2ffc6d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84ef74e-7908-4bd5-92ea-b3147d1c13b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c84ef74e-7908-4bd5-92ea-b3147d1c13b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7859174c-a400-48bc-a400-aba1c17727af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7859174c-a400-48bc-a400-aba1c17727af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11', 'volume_name': 'volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbf5a93-ab7b-4748-ba19-1ced899d7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcbf5a93-ab7b-4748-ba19-1ced899d7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65fb61d-8c6d-460e-815b-a24a82940641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:43 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Volume edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11', 'volume_size': 1}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1302481001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18aafaf961594009b479a1f8b53a1421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:43Z,use_quota=True,user_id='50cc99bb74604ff4bf60354d2ffc6d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Creating volume edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:43 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:43 devstack sudo[96593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11 1073741824
Sep 06 17:04:43 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-542d86b9-8340-4d75-882c-abace267c23b req-3c6099e7-4d57-4334-8f50-4b8780215ab8 tempest-AttachVolumeNegativeTest-543811115 None] Terminate volume connection completed successfully.
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-542d86b9-8340-4d75-882c-abace267c23b req-3c6099e7-4d57-4334-8f50-4b8780215ab8 tempest-AttachVolumeNegativeTest-543811115 None] Deleting attachment 2b662a6f-0ff6-4066-9f5a-d297e6556571. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:04:43 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11 1073741824" returned: 0 in 0.513s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:43 devstack sudo[96625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11
Sep 06 17:04:43 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:44 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11" returned: 0 in 0.268s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a65fb61d-8c6d-460e-815b-a24a82940641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff84841-0249-43b4-8a43-b74ffffae4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:44 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Volume volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11 (edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11): created successfully
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ff84841-0249-43b4-8a43-b74ffffae4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Flow 'volume_create_manager' (7966590e-1a73-4923-9c9c-503b34605ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:44 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7d273b7b-8824-469a-bc87-9923b2d360e8 tempest-VolumesListAdminTestJSON-1123472916 None] Created volume successfully.
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (72f6c123-2391-4c51-99aa-ce82e4694346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d540c293-2a20-4e81-9b7d-c0cb58f144cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d540c293-2a20-4e81-9b7d-c0cb58f144cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1423444893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2976e58a-05cc-4629-8696-a8e3e9145b8b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:44Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3997440d-2ccb-49c2-86d8-07cecc9da7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3997440d-2ccb-49c2-86d8-07cecc9da7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f521ccc-51c5-4cac-a026-ff7226c98895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f521ccc-51c5-4cac-a026-ff7226c98895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2976e58a-05cc-4629-8696-a8e3e9145b8b', 'volume_name': 'volume-2976e58a-05cc-4629-8696-a8e3e9145b8b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174dc47a-4053-486d-b505-082473a4fa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174dc47a-4053-486d-b505-082473a4fa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd58978d-cf61-4cef-a2b7-4ffc3160dd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:44 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Volume 2976e58a-05cc-4629-8696-a8e3e9145b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2976e58a-05cc-4629-8696-a8e3e9145b8b', 'volume_size': 1}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1423444893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2976e58a-05cc-4629-8696-a8e3e9145b8b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:44Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Creating volume 2976e58a-05cc-4629-8696-a8e3e9145b8b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:44 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:44 devstack sudo[96628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b 1073741824
Sep 06 17:04:44 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:45 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b 1073741824" returned: 0 in 0.660s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:45 devstack sudo[96654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b
Sep 06 17:04:45 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:45 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b" returned: 0 in 0.337s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd58978d-cf61-4cef-a2b7-4ffc3160dd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2976e58a-05cc-4629-8696-a8e3e9145b8b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e361cf8-2499-41e2-80cb-4be0b2a0e472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:45 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Volume volume-2976e58a-05cc-4629-8696-a8e3e9145b8b (2976e58a-05cc-4629-8696-a8e3e9145b8b): created successfully
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e361cf8-2499-41e2-80cb-4be0b2a0e472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (72f6c123-2391-4c51-99aa-ce82e4694346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b84bd88a-81c7-4492-8a71-4e134d31d158 tempest-VolumesGetTest-1302899881 None] Created volume successfully.
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Flow 'volume_create_manager' (466d16ee-6c0f-46dc-97ed-85c3db9bdd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39a8e8b-f43b-449e-930c-460d823858ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39a8e8b-f43b-449e-930c-460d823858ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26dd4c2b-9b8a-4d05-8326-54ec7633a793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cabfb80837aa4d88ac8d3d8a7269a2e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:46Z,use_quota=True,user_id='9853a23f586f465f97ccb2fb67ea7cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6c8db6-eb6f-4645-a4a8-3ec5b02c3586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a6c8db6-eb6f-4645-a4a8-3ec5b02c3586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3736730c-26f7-41cc-8d30-71c54b667a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3736730c-26f7-41cc-8d30-71c54b667a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26dd4c2b-9b8a-4d05-8326-54ec7633a793', 'volume_name': 'volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c261110c-e216-4e0e-933e-221fcb7e74ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c261110c-e216-4e0e-933e-221fcb7e74ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c89d5a-abea-4cb1-a361-3ccb90987e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:46 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Volume 26dd4c2b-9b8a-4d05-8326-54ec7633a793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793', 'volume_size': 1}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26dd4c2b-9b8a-4d05-8326-54ec7633a793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cabfb80837aa4d88ac8d3d8a7269a2e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:46Z,use_quota=True,user_id='9853a23f586f465f97ccb2fb67ea7cbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Creating volume 26dd4c2b-9b8a-4d05-8326-54ec7633a793 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:46 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:46 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793 1073741824
Sep 06 17:04:46 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:46 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793 1073741824" returned: 0 in 0.523s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:46 devstack sudo[96666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793
Sep 06 17:04:46 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:46 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793" returned: 0 in 0.267s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c89d5a-abea-4cb1-a361-3ccb90987e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24820b4f-19fd-4ac0-888e-1517644e069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:46 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Volume volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793 (26dd4c2b-9b8a-4d05-8326-54ec7633a793): created successfully
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24820b4f-19fd-4ac0-888e-1517644e069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Flow 'volume_create_manager' (466d16ee-6c0f-46dc-97ed-85c3db9bdd6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:46 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1fdd65fa-19b0-4069-9ac6-4be2e3d5aeae tempest-VolumesListAdminTestJSON-724825981 None] Created volume successfully.
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (f3fc10cd-1560-4946-8678-82610753de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbe0d77-8671-4b2b-a8fb-ff1f4417d40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fbe0d77-8671-4b2b-a8fb-ff1f4417d40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-713279513',display_name='tempest-VolumesGetTest-Volume-2000023284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b2bfd7-be7b-4251-8752-faad3bf8f9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:47Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55194bc7-84bb-41de-8640-9453a0d9d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55194bc7-84bb-41de-8640-9453a0d9d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f8350c-e4ce-4a23-bdb2-6fc3397f2fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f8350c-e4ce-4a23-bdb2-6fc3397f2fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b2bfd7-be7b-4251-8752-faad3bf8f9de', 'volume_name': 'volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f147fb-2375-421e-af4d-5f7b0205fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f147fb-2375-421e-af4d-5f7b0205fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3321ce7a-40aa-46af-b88b-5d2fdd6b31be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:47 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Volume 88b2bfd7-be7b-4251-8752-faad3bf8f9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de', 'volume_size': 1}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-713279513',display_name='tempest-VolumesGetTest-Volume-2000023284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b2bfd7-be7b-4251-8752-faad3bf8f9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:47Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Creating volume 88b2bfd7-be7b-4251-8752-faad3bf8f9de {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:47 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:47 devstack sudo[96669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de 1073741824
Sep 06 17:04:47 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:47 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de 1073741824" returned: 0 in 0.445s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:47 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de
Sep 06 17:04:47 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Acquiring lock "cinder-26dd4c2b-9b8a-4d05-8326-54ec7633a793-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Lock "cinder-26dd4c2b-9b8a-4d05-8326-54ec7633a793-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:48 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de" returned: 0 in 0.290s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3321ce7a-40aa-46af-b88b-5d2fdd6b31be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5040b81c-5b8e-4c51-b97d-deae990466f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:48 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Volume volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de (88b2bfd7-be7b-4251-8752-faad3bf8f9de): created successfully
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5040b81c-5b8e-4c51-b97d-deae990466f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (f3fc10cd-1560-4946-8678-82610753de15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Acquiring lock "cinder-quobyte-26dd4c2b-9b8a-4d05-8326-54ec7633a793" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Lock "cinder-quobyte-26dd4c2b-9b8a-4d05-8326-54ec7633a793" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-2bdb169a-8109-4528-9a49-4abc1ef73cc4 tempest-VolumesGetTest-1302899881 None] Created volume successfully.
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c73153b-1c05-47a7-905b-58836ee089b0]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "cinder-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "cinder-quobyte-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-quobyte-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e96fa16-09ca-43b4-9e6d-4ad430aece23]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:48 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793
Sep 06 17:04:48 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:48 devstack sudo[96680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11
Sep 06 17:04:48 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:48 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793" returned: 0 in 0.491s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:48 devstack sudo[96688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793
Sep 06 17:04:48 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:48 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11" returned: 0 in 0.406s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:48 devstack sudo[96691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11
Sep 06 17:04:49 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:49 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-26dd4c2b-9b8a-4d05-8326-54ec7633a793" returned: 0 in 0.270s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Lock "cinder-quobyte-26dd4c2b-9b8a-4d05-8326-54ec7633a793" released by "delete_volume" :: held 0.821s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Created reservations ['5614d08f-becb-4021-99ec-c2062cb58c73', '348ba02b-9b39-4ea8-a482-8035f0559ffb', '254ff07d-745b-44c7-ab23-0c7b42087f5f', '9a1966f8-b80b-4e15-a174-d314e27d6703'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:49 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-quobyte-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11" released by "delete_volume" :: held 0.734s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Created reservations ['8025c07f-0c69-4262-9f82-455c53e2958c', '261f40be-8851-4991-b70c-86809bb3b421', '32efac07-9964-4c16-95df-2186e0d20d7f', 'b2b3e32b-be91-4e18-97c0-f3d31b833a90'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:49 devstack sudo[96695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:49 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:49 devstack sudo[96697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:49 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:49 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.286s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:49 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Deleted volume successfully.
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-88b2bfd7-be7b-4251-8752-faad3bf8f9de-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6c2c016d-e4c4-4500-b89a-e9280e33afe9 tempest-VolumesListAdminTestJSON-724825981 None] Lock "cinder-26dd4c2b-9b8a-4d05-8326-54ec7633a793-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Lock "cinder-88b2bfd7-be7b-4251-8752-faad3bf8f9de-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-quobyte-88b2bfd7-be7b-4251-8752-faad3bf8f9de" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-88b2bfd7-be7b-4251-8752-faad3bf8f9de" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "cinder-be266d61-d72f-4b7d-baf1-2b1d5d838af3-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ed2b95-6daa-4c1f-a3c1-3a81e2652ba5]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-be266d61-d72f-4b7d-baf1-2b1d5d838af3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "cinder-quobyte-be266d61-d72f-4b7d-baf1-2b1d5d838af3" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:49 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.414s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:49 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Deleted volume successfully.
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-quobyte-be266d61-d72f-4b7d-baf1-2b1d5d838af3" acquired by "delete_volume" :: waited 0.038s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:49 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de
Sep 06 17:04:49 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94b73f6d-ac0d-4166-a918-edc6c5e372c7 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-edb36c1b-8f2c-4eb1-9cfa-09ea9eb5ad11-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56536f3-03e9-42d0-ad5c-1044f27b515a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:50 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3
Sep 06 17:04:50 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:50 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de" returned: 0 in 0.443s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:50 devstack sudo[96709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de
Sep 06 17:04:50 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:50 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3" returned: 0 in 0.424s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:50 devstack sudo[96714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3
Sep 06 17:04:50 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:50 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-88b2bfd7-be7b-4251-8752-faad3bf8f9de" returned: 0 in 0.306s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-88b2bfd7-be7b-4251-8752-faad3bf8f9de" released by "delete_volume" :: held 0.803s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Created reservations ['2e8b1f5c-14a9-48bf-b200-9d65c48db128', 'e3b58b77-ae76-44e9-b706-9c2a6d721db2', 'd4f334b6-78d9-4c27-a69a-5334abc882eb', '2a3bda77-a268-442a-b7e4-51c84a77357e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:50 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-be266d61-d72f-4b7d-baf1-2b1d5d838af3" returned: 0 in 0.259s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-quobyte-be266d61-d72f-4b7d-baf1-2b1d5d838af3" released by "delete_volume" :: held 0.744s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:50 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:50 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Created reservations ['d34063f9-6311-4158-9d35-cf414cf163b7', '38d4321d-daaf-47a6-a6ad-1d5cff7ea009', '210a7716-5571-4811-961e-16090c226341', 'c008d236-d17e-42a5-8ff4-7d0efb4a72ca'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:50 devstack sudo[96720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:50 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-2976e58a-05cc-4629-8696-a8e3e9145b8b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Lock "cinder-2976e58a-05cc-4629-8696-a8e3e9145b8b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:51 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.377s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-quobyte-2976e58a-05cc-4629-8696-a8e3e9145b8b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:51 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Deleted volume successfully.
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "cinder-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-2976e58a-05cc-4629-8696-a8e3e9145b8b" acquired by "delete_volume" :: waited 0.038s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4fa87d7-d065-4588-8631-a0d2284de3c4 tempest-VolumesGetTest-1302899881 None] Lock "cinder-88b2bfd7-be7b-4251-8752-faad3bf8f9de-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fa1456-2a46-487f-b1f0-ea9495b2404e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "cinder-quobyte-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-quobyte-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cb5aa1-c345-4b00-9506-294373623962]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:51 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.451s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:51 devstack sudo[96723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b
Sep 06 17:04:51 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:51 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Deleted volume successfully.
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4a5ed14-deaf-4e71-b76c-1a264ebac342 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-be266d61-d72f-4b7d-baf1-2b1d5d838af3-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:51 devstack sudo[96726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b
Sep 06 17:04:51 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:51 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b" returned: 0 in 0.399s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:51 devstack sudo[96734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b
Sep 06 17:04:51 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:51 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b" returned: 0 in 0.427s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:51 devstack sudo[96742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b
Sep 06 17:04:51 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:51 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2976e58a-05cc-4629-8696-a8e3e9145b8b" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-2976e58a-05cc-4629-8696-a8e3e9145b8b" released by "delete_volume" :: held 0.756s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Created reservations ['8a49e0f3-9b52-4702-a325-39128e336df4', 'c25c9c5d-fdcb-451d-9305-b3e22543cdec', 'fd77ac30-74dc-49a8-9124-f9d13e5e38c0', '3fa7391c-adb0-492f-8f40-6ea5cf07c8b6'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:51 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-quobyte-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b" released by "delete_volume" :: held 0.740s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:52 devstack sudo[96746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:52 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Created reservations ['d97ee2e9-b76b-4645-974f-cd9b801ed008', '00843df2-438f-4a60-a95a-7f4bc965d2f6', '2804ef03-6545-46b7-a378-eadd3ffbcd96', '994dff78-6224-46a6-bddf-26ef7fbe560b'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:52 devstack sudo[96748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:04:52 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:52 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.341s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:52 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Deleted volume successfully.
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-182575d3-7144-4045-b67d-dc417c118436 tempest-VolumesGetTest-1302899881 None] Lock "cinder-2976e58a-05cc-4629-8696-a8e3e9145b8b-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:52 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.387s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:04:52 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Deleted volume successfully.
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f421bc00-a966-4160-a2bb-1ae98daf0e10 tempest-VolumesListAdminTestJSON-1123472916 None] Lock "cinder-5ae6483b-83ff-4e09-b5eb-6a67d34fa20b-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (b179ffec-4edd-4597-8c53-7e84d1669052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b817ae3e-a225-47c8-a8d0-34b31c3bdf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b817ae3e-a225-47c8-a8d0-34b31c3bdf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-19483033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed9cc80-b9b2-4562-b792-6f9a627b2754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:53Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f46691-a8f3-40ba-baba-c03e168eda05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f46691-a8f3-40ba-baba-c03e168eda05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0f5be4-174d-4f77-9b1b-e9948f1b5ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0f5be4-174d-4f77-9b1b-e9948f1b5ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed9cc80-b9b2-4562-b792-6f9a627b2754', 'volume_name': 'volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73340341-13df-46bd-8079-4aa94e514283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73340341-13df-46bd-8079-4aa94e514283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1bbb8b-27e3-40d6-ab37-20f3f98714e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:53 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Volume 7ed9cc80-b9b2-4562-b792-6f9a627b2754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754', 'volume_size': 1}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-19483033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed9cc80-b9b2-4562-b792-6f9a627b2754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:53Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Creating volume 7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:04:53 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:53 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 1073741824
Sep 06 17:04:53 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:53 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 1073741824" returned: 0 in 0.696s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:53 devstack sudo[96770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754
Sep 06 17:04:53 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:54 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754" returned: 0 in 0.462s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:04:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1bbb8b-27e3-40d6-ab37-20f3f98714e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eed0cf9-aca2-4f15-8ce9-b73fe5c24b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:54 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Volume volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 (7ed9cc80-b9b2-4562-b792-6f9a627b2754): created successfully
Sep 06 17:04:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eed0cf9-aca2-4f15-8ce9-b73fe5c24b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (b179ffec-4edd-4597-8c53-7e84d1669052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c5f4c77f-2a57-4d91-a966-d2b6ae99818f tempest-VolumesGetTest-1302899881 None] Created volume successfully.
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (784fbef2-9b08-4350-851e-dfc4930a48c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088be21d-88fb-4285-b4d0-ebfad50c23b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (088be21d-88fb-4285-b4d0-ebfad50c23b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-643996914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac17c43e-1bdd-4dba-b8af-02fd0e028e34,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=7ed9cc80-b9b2-4562-b792-6f9a627b2754,status='creating',terminated_at=None,updated_at=2026-09-06T15:04:56Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e3eaec-a988-4e82-80d5-373ffd7da8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e3eaec-a988-4e82-80d5-373ffd7da8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c928b3-e32c-454e-b6fa-67b9f8d9b102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c928b3-e32c-454e-b6fa-67b9f8d9b102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ac17c43e-1bdd-4dba-b8af-02fd0e028e34', 'volume_name': 'volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34', 'volume_size': 1, 'source_volid': '7ed9cc80-b9b2-4562-b792-6f9a627b2754', 'source_volstatus': 'available'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf5a9bc-6fe6-41d1-bf45-eac3c63cf376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf5a9bc-6fe6-41d1-bf45-eac3c63cf376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec757ebd-d2d2-4c7c-9e6e-e826f4113a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:04:55 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Volume ac17c43e-1bdd-4dba-b8af-02fd0e028e34: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34', 'volume_size': 1, 'source_volid': '7ed9cc80-b9b2-4562-b792-6f9a627b2754', 'source_volstatus': 'available'}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:55 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Cloning volume 7ed9cc80-b9b2-4562-b792-6f9a627b2754 to volume ac17c43e-1bdd-4dba-b8af-02fd0e028e34
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Creating offline snapshot 7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 of volume 7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[63323107-30a8-4fe2-9305-05b5de3d4643]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:56 devstack sudo[96779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754
Sep 06 17:04:56 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:56 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754" returned: 0 in 0.480s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:56 devstack sudo[96792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 1G
Sep 06 17:04:56 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:57 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 1G" returned: 0 in 0.803s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:57 devstack sudo[96848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16
Sep 06 17:04:57 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:57 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16" returned: 0 in 0.678s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:57 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 is being set with open permissions: ugo+rw
Sep 06 17:04:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:57 devstack sudo[96897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16
Sep 06 17:04:57 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:58 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:58 devstack sudo[96906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.info
Sep 06 17:04:58 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:58 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.info" returned: 0 in 0.473s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:58 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.info is being set with open permissions: ugo+rw
Sep 06 17:04:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:58 devstack sudo[96909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.info
Sep 06 17:04:58 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:59 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.info" returned: 0 in 0.360s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-quobyte-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] snapshot: 7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16, volume: ac17c43e-1bdd-4dba-b8af-02fd0e028e34,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c04eb-6559-47a5-b982-13abb6dfec6f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:04:59 devstack sudo[96912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16
Sep 06 17:04:59 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:04:59 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16" returned: 0 in 0.599s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f459f85-00e0-4eea-9a14-c070e9da66e1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:04:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:00 devstack sudo[96917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754
Sep 06 17:05:00 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:00 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754" returned: 0 in 0.590s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:05:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:05:00 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34 not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:05:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:00 devstack sudo[96923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34
Sep 06 17:05:00 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:07 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" returned: 0 in 6.900s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:05:07 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Converted 1024.00 MB image at 148.39 MB/s
Sep 06 17:05:07 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34 is being set with open permissions: ugo+rw
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:07 devstack sudo[96941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34
Sep 06 17:05:07 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:07 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" returned: 0 in 0.251s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" released by "_copy_volume_from_snapshot" :: held 8.471s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-quobyte-7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Deleting offline snapshot 7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 of volume 7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] snapshot_file for this snap is: volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[285d6b0b-23ef-4e2b-80f2-a6b7cb1c18a4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:07 devstack sudo[96944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16
Sep 06 17:05:07 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:08 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16" returned: 0 in 0.451s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[990e1020-8e84-47fe-9d67-bb94e014bcdd]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Flow 'volume_create_manager' (dc3f2789-fe81-4faa-847c-9e35884389cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f2578b-1de1-45ff-8579-63f6e64c453d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f2578b-1de1-45ff-8579-63f6e64c453d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2006540192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edc8708-f417-45e3-b19c-29697ae9d510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513aff64625047edafc5d38c8ec98242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:08Z,use_quota=True,user_id='ff06d2c493b04bd281b20e0a0659e3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cae02c-3903-41dc-a6b3-367e2a14d85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94cae02c-3903-41dc-a6b3-367e2a14d85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f8654e-0d3b-47b2-907c-62ce982cf895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:05:08 devstack sudo[96949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754
Sep 06 17:05:08 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f8654e-0d3b-47b2-907c-62ce982cf895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2edc8708-f417-45e3-b19c-29697ae9d510', 'volume_name': 'volume-2edc8708-f417-45e3-b19c-29697ae9d510', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008a5a2d0>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9213626c-bf56-41ff-8813-b072ead17e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9213626c-bf56-41ff-8813-b072ead17e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82faea8-3721-4f93-ae1d-974b3be744de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:08 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Volume 2edc8708-f417-45e3-b19c-29697ae9d510: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2edc8708-f417-45e3-b19c-29697ae9d510', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008a5a2d0>}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Trying to clone 2edc8708-f417-45e3-b19c-29697ae9d510 from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:05:08 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754" returned: 0 in 0.566s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:08 devstack sudo[96954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16
Sep 06 17:05:08 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:05:09 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Image download 20.69 MB at 20.69 MB/s
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[215add69-aeca-4ec1-8ca5-778200654196]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:09 devstack sudo[96957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD
Sep 06 17:05:09 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:09 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16" returned: 0 in 0.498s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:09 devstack sudo[96963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16
Sep 06 17:05:09 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:09 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf is fetched for user ff06d2c493b04bd281b20e0a0659e3a7. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f6db1f-6573-431f-bb7c-1b525b194784]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:09 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754.7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-7b4ea1a4-fd1c-486b-ba0e-ecc6a91a7c16" released by "_delete_snapshot" :: held 1.886s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.806s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:09 devstack sudo[96969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD
Sep 06 17:05:09 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec757ebd-d2d2-4c7c-9e6e-e826f4113a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34', 'volume_size': 1, 'source_volid': '7ed9cc80-b9b2-4562-b792-6f9a627b2754', 'source_volstatus': 'available'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca775504-9034-40c6-a837-7b4b0ed0a1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:09 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Volume volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34 (ac17c43e-1bdd-4dba-b8af-02fd0e028e34): created successfully
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca775504-9034-40c6-a837-7b4b0ed0a1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (784fbef2-9b08-4350-851e-dfc4930a48c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:09 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cd022631-156f-409d-b97b-ea9fd3e9db10 tempest-VolumesGetTest-1302899881 None] Created volume successfully.
Sep 06 17:05:09 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2006540192',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2edc8708-f417-45e3-b19c-29697ae9d510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513aff64625047edafc5d38c8ec98242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:08Z,use_quota=True,user_id='ff06d2c493b04bd281b20e0a0659e3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Creating volume 2edc8708-f417-45e3-b19c-29697ae9d510 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:09 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:09 devstack sudo[96974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 1073741824
Sep 06 17:05:09 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:10 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 1073741824" returned: 0 in 0.515s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:10 devstack sudo[96980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510
Sep 06 17:05:10 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:10 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510" returned: 0 in 0.272s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:10 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Attempting download of 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume 2edc8708-f417-45e3-b19c-29697ae9d510. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:05:10 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f099c242-d285-4c04-99db-43fcef08d8a0]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_dktyyjz6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:11 devstack sudo[96983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_dktyyjz6
Sep 06 17:05:11 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (c59a8707-5416-4e68-8673-ecb3b40d15f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:11 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd9323-534f-485e-8164-d4ecf5533abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_dktyyjz6" returned: 0 in 0.517s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_dktyyjz6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5afd9323-534f-485e-8164-d4ecf5533abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-943354273',display_name='tempest-VolumesGetTest-Volume-1486942136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287cc4b6-7adf-4b5f-b35f-15706cb94db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:11Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2fea38-392e-494c-aaff-87b00e09fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2fea38-392e-494c-aaff-87b00e09fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc64cee-60ad-416a-b2e7-0c9996773706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc64cee-60ad-416a-b2e7-0c9996773706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287cc4b6-7adf-4b5f-b35f-15706cb94db2', 'volume_name': 'volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7ab1f8-8388-42df-890d-4ad504eabb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7ab1f8-8388-42df-890d-4ad504eabb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ea2eb6-cda0-40b0-9722-b74f1fbf9295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:11 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Volume 287cc4b6-7adf-4b5f-b35f-15706cb94db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2', 'volume_size': 1}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-943354273',display_name='tempest-VolumesGetTest-Volume-1486942136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287cc4b6-7adf-4b5f-b35f-15706cb94db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:11Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Creating volume 287cc4b6-7adf-4b5f-b35f-15706cb94db2 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:11 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:11 devstack sudo[97003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2 1073741824
Sep 06 17:05:11 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:11 devstack sudo[97002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_dktyyjz6
Sep 06 17:05:11 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:11 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_dktyyjz6" returned: 1 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_dktyyjz6' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c497f2fd-4d32-4756-8f28-1a89e0c3b305]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:11 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:11 devstack sudo[97011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD
Sep 06 17:05:11 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2 1073741824" returned: 0 in 0.408s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:11 devstack sudo[97014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2
Sep 06 17:05:11 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:12 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] 23f4b67c-17a9-402c-a0ff-7560fceb54cf was qcow2, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:12 devstack sudo[97019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510
Sep 06 17:05:12 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:12 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ea2eb6-cda0-40b0-9722-b74f1fbf9295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d13ba31-9ddb-4f13-8473-a520bfaaf8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:12 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Volume volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2 (287cc4b6-7adf-4b5f-b35f-15706cb94db2): created successfully
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d13ba31-9ddb-4f13-8473-a520bfaaf8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (c59a8707-5416-4e68-8673-ecb3b40d15f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d285cd2a-69e0-45d8-8aa9-b4f83df98faf tempest-VolumesGetTest-1302899881 None] Created volume successfully.
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-287cc4b6-7adf-4b5f-b35f-15706cb94db2-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Lock "cinder-287cc4b6-7adf-4b5f-b35f-15706cb94db2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-quobyte-287cc4b6-7adf-4b5f-b35f-15706cb94db2" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-287cc4b6-7adf-4b5f-b35f-15706cb94db2" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d022a6-aeec-45db-8c3f-dd7c5b0c88fb]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:13 devstack sudo[97028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2
Sep 06 17:05:13 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:13 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510" returned: 0 in 1.655s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_wmjuzkwudevstack@QuobyteHD, size 112.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:05:13 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Converted 112.00 MB image at 67.63 MB/s
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:13 devstack sudo[97030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 1G
Sep 06 17:05:13 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:13 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2" returned: 0 in 0.394s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:14 devstack sudo[97037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2
Sep 06 17:05:14 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:14 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 1G" returned: 0 in 0.341s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Downloaded image 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume 2edc8708-f417-45e3-b19c-29697ae9d510 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf for user ff06d2c493b04bd281b20e0a0659e3a7 is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Marking volume 2edc8708-f417-45e3-b19c-29697ae9d510 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Copying metadata from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf to 2edc8708-f417-45e3-b19c-29697ae9d510. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Creating volume glance metadata for volume 2edc8708-f417-45e3-b19c-29697ae9d510 backed by image 23f4b67c-17a9-402c-a0ff-7560fceb54cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82faea8-3721-4f93-ae1d-974b3be744de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2edc8708-f417-45e3-b19c-29697ae9d510', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008a5a2d0>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee13907-c8a0-41de-b0f1-6f9ca96cb910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:14 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Volume volume-2edc8708-f417-45e3-b19c-29697ae9d510 (2edc8708-f417-45e3-b19c-29697ae9d510): created successfully
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee13907-c8a0-41de-b0f1-6f9ca96cb910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Flow 'volume_create_manager' (dc3f2789-fe81-4faa-847c-9e35884389cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:14 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e387b80a-bd68-437a-9e9d-39e17b63cb23 tempest-VolumesImageMetadata-1432713092 None] Created volume successfully.
Sep 06 17:05:14 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-287cc4b6-7adf-4b5f-b35f-15706cb94db2" returned: 0 in 0.281s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-287cc4b6-7adf-4b5f-b35f-15706cb94db2" released by "delete_volume" :: held 0.719s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Created reservations ['3fa800ca-338f-4aa6-8405-aa4ba0b21a91', '14812f11-5c48-4055-9583-f5bfce305591', 'ef20d02d-75ad-423f-aaa6-aae7b96ca99c', 'c1e769f1-dcdf-43a8-9267-2b3af8375bd1'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:14 devstack sudo[97042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:14 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:14 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:14 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Deleted volume successfully.
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7caa1266-2411-4a39-910e-0b800d3551fd tempest-VolumesGetTest-1302899881 None] Lock "cinder-287cc4b6-7adf-4b5f-b35f-15706cb94db2-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-ac17c43e-1bdd-4dba-b8af-02fd0e028e34-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Lock "cinder-ac17c43e-1bdd-4dba-b8af-02fd0e028e34-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-quobyte-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe9fe06-fa62-46af-b3fa-bcbb4b834796]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:14 devstack sudo[97045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34
Sep 06 17:05:14 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Acquiring lock "cinder-2edc8708-f417-45e3-b19c-29697ae9d510-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Lock "cinder-2edc8708-f417-45e3-b19c-29697ae9d510-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Acquiring lock "cinder-quobyte-2edc8708-f417-45e3-b19c-29697ae9d510" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Lock "cinder-quobyte-2edc8708-f417-45e3-b19c-29697ae9d510" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e475e3c-17da-4f58-9610-da9e3a2300c9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:15 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" returned: 0 in 0.412s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:15 devstack sudo[97051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34
Sep 06 17:05:15 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:15 devstack sudo[97047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510
Sep 06 17:05:15 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:15 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" returned: 0 in 0.265s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-ac17c43e-1bdd-4dba-b8af-02fd0e028e34" released by "delete_volume" :: held 0.729s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:15 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510" returned: 0 in 0.385s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:15 devstack sudo[97058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510
Sep 06 17:05:15 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Created reservations ['9e51daa7-f445-46ab-bb45-0f7118ca4bea', '658146cd-6429-4718-a7b6-2e4421018e8c', '7a936dff-4f93-441b-bad7-1b1c2cdb1615', 'f704d71a-0aa5-486c-82ac-db48c2412abd'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:15 devstack sudo[97060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:15 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:15 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2edc8708-f417-45e3-b19c-29697ae9d510" returned: 0 in 0.244s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Lock "cinder-quobyte-2edc8708-f417-45e3-b19c-29697ae9d510" released by "delete_volume" :: held 0.677s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Created reservations ['1a3d37e3-62d9-4d7e-bd31-276012aa2934', '0acf109e-e58c-4a11-b532-1ea458c3b58c', 'b9b0c8aa-be82-4055-bdf1-32a1b949dd57', '934085d3-9371-4085-a01d-426d52de3de7'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:15 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.269s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Deleted volume successfully.
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-7ed9cc80-b9b2-4562-b792-6f9a627b2754-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705252c7-c573-4aba-82c7-8eeac0edd3fa tempest-VolumesGetTest-1302899881 None] Lock "cinder-ac17c43e-1bdd-4dba-b8af-02fd0e028e34-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:16 devstack sudo[97064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:16 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Lock "cinder-7ed9cc80-b9b2-4562-b792-6f9a627b2754-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=174,cinder:SELECT=134,cinder:INSERT=49,cinder:DELETE=12 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-quobyte-7ed9cc80-b9b2-4562-b792-6f9a627b2754" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-7ed9cc80-b9b2-4562-b792-6f9a627b2754" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e6d90b-a7c6-4f43-b5e9-8501edbf700b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:16 devstack sudo[97066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754
Sep 06 17:05:16 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:16 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Deleted volume successfully.
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-688af771-1ae3-4393-8795-7e9797081670 tempest-VolumesImageMetadata-1432713092 None] Lock "cinder-2edc8708-f417-45e3-b19c-29697ae9d510-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:16 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754" returned: 0 in 0.400s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:16 devstack sudo[97072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754
Sep 06 17:05:16 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:16 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7ed9cc80-b9b2-4562-b792-6f9a627b2754" returned: 0 in 0.257s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-7ed9cc80-b9b2-4562-b792-6f9a627b2754" released by "delete_volume" :: held 0.721s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=134,cinder:UPDATE=161,cinder:INSERT=51,cinder:DELETE=16 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Created reservations ['32995a86-8793-48cd-9531-78fa854840ba', 'aef35c28-d222-402a-9eb5-8617d6f9316d', '56a24675-211c-43de-8ee1-5157cae2f6ac', '2f998e20-3559-44dc-b4a5-d3ffc7dcdc8e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:16 devstack sudo[97075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:16 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:17 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.280s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:17 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:17 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Deleted volume successfully.
Sep 06 17:05:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b463f1c9-d26b-48d6-8091-dbbccf05e5c7 tempest-VolumesGetTest-1302899881 None] Lock "cinder-7ed9cc80-b9b2-4562-b792-6f9a627b2754-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:17 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (edeadab1-f57f-427e-a55f-4602a4b861db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bb3fbc-7f6a-482a-aa2f-e30aaa0cf619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bb3fbc-7f6a-482a-aa2f-e30aaa0cf619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1114866419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fafcbca-3e09-4d56-ae9a-d40f784c6c51,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:18Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096e116d-112e-4266-b196-1e2c7d9dbfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096e116d-112e-4266-b196-1e2c7d9dbfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6240e17-d520-4087-a327-1155c8756c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6240e17-d520-4087-a327-1155c8756c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2fafcbca-3e09-4d56-ae9a-d40f784c6c51', 'volume_name': 'volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008da47d0>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17471107-a737-4e1b-984f-b65c22f18a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17471107-a737-4e1b-984f-b65c22f18a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095ea660-fbd7-4ef7-a2b8-fd423570f54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:18 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Volume 2fafcbca-3e09-4d56-ae9a-d40f784c6c51: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008da47d0>}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Trying to clone 2fafcbca-3e09-4d56-ae9a-d40f784c6c51 from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:05:18 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Image download 20.69 MB at 20.69 MB/s
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a9f04-89dc-4e2e-beb1-7e2227a281aa]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:18 devstack sudo[97085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD
Sep 06 17:05:18 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:19 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf is fetched for user c9c83394dbed44608893a3c36c1bf3c8. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed3417-2505-49d2-bfb6-fd82aa6a76e9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:19 devstack sudo[97090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD
Sep 06 17:05:19 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:19 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1114866419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fafcbca-3e09-4d56-ae9a-d40f784c6c51,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:18Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Creating volume 2fafcbca-3e09-4d56-ae9a-d40f784c6c51 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:19 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:19 devstack sudo[97095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 1073741824
Sep 06 17:05:19 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:20 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 1073741824" returned: 0 in 0.463s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:20 devstack sudo[97101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51
Sep 06 17:05:20 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:20 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51" returned: 0 in 0.254s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Attempting download of 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume 2fafcbca-3e09-4d56-ae9a-d40f784c6c51. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c6216-2896-4dc9-a615-084efe250820]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_nuenyw80 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:20 devstack sudo[97106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_nuenyw80
Sep 06 17:05:20 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:20 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_nuenyw80" returned: 0 in 0.345s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_nuenyw80 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:21 devstack sudo[97110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_nuenyw80
Sep 06 17:05:21 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:21 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_nuenyw80" returned: 1 in 0.369s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_nuenyw80' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f25844-a7b1-43c3-ba08-e9d8dd0708a8]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Flow 'volume_create_manager' (23c1856f-3c0d-4213-be26-1b8d8a1708a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcc0316-51db-45d7-aae2-971ea4678786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack sudo[97115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD
Sep 06 17:05:21 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbcc0316-51db-45d7-aae2-971ea4678786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1503732204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b14b57-0c64-4d1a-876c-543f152ae5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e1b6dbf8c2436abeff157abc2b2488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:21Z,use_quota=True,user_id='0f41c38c001f4a589b4253fdedb6ed23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca805b2c-2461-491f-bddd-c0995e6e6256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca805b2c-2461-491f-bddd-c0995e6e6256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea78698f-f497-4414-a1d4-e0fed16bd6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea78698f-f497-4414-a1d4-e0fed16bd6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b14b57-0c64-4d1a-876c-543f152ae5f5', 'volume_name': 'volume-90b14b57-0c64-4d1a-876c-543f152ae5f5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5c58dd-36c7-4b73-ae60-7411d5111794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5c58dd-36c7-4b73-ae60-7411d5111794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa96970d-ce4b-43a9-a378-1749ec755bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Volume 90b14b57-0c64-4d1a-876c-543f152ae5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b14b57-0c64-4d1a-876c-543f152ae5f5', 'volume_size': 1}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1503732204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b14b57-0c64-4d1a-876c-543f152ae5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14e1b6dbf8c2436abeff157abc2b2488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:21Z,use_quota=True,user_id='0f41c38c001f4a589b4253fdedb6ed23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Creating volume 90b14b57-0c64-4d1a-876c-543f152ae5f5 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:21 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:21 devstack sudo[97118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5 1073741824
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:21 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Flow 'volume_create_manager' (a99caf70-fdb6-4a8c-8295-4b78454d48dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40fff102-cb91-46a7-a33d-675ef0ee2c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40fff102-cb91-46a7-a33d-675ef0ee2c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-695529293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383c492582234c45a975f2f668d38fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:21Z,use_quota=True,user_id='bab2f2b3c5044b17a1ed6eda3f2d2aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3ec4b5-85f3-46b5-bf77-ba4696c35bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3ec4b5-85f3-46b5-bf77-ba4696c35bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284a0f24-5eb6-471b-9a2f-60dd40ba406c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284a0f24-5eb6-471b-9a2f-60dd40ba406c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a', 'volume_name': 'volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d42b60-d27f-4752-96b8-eb381abaec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d42b60-d27f-4752-96b8-eb381abaec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7192053b-0a21-40c3-aac5-a584f35e3491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:21 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Volume 726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a', 'volume_size': 1}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:21 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] 23f4b67c-17a9-402c-a0ff-7560fceb54cf was qcow2, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:21 devstack sudo[97123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51
Sep 06 17:05:21 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:21 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5 1073741824" returned: 0 in 0.421s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:21 devstack sudo[97132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5
Sep 06 17:05:21 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:22 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-695529293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='383c492582234c45a975f2f668d38fc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:21Z,use_quota=True,user_id='bab2f2b3c5044b17a1ed6eda3f2d2aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Creating volume 726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:22 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa96970d-ce4b-43a9-a378-1749ec755bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b14b57-0c64-4d1a-876c-543f152ae5f5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:22 devstack sudo[97137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a 1073741824
Sep 06 17:05:22 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1113d1c5-26f6-4c51-aabe-46ae924504e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:22 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Volume volume-90b14b57-0c64-4d1a-876c-543f152ae5f5 (90b14b57-0c64-4d1a-876c-543f152ae5f5): created successfully
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1113d1c5-26f6-4c51-aabe-46ae924504e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Flow 'volume_create_manager' (23c1856f-3c0d-4213-be26-1b8d8a1708a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-2e69e928-1861-4de9-ba09-c60827691ccf tempest-AbsoluteLimitsTests-2127111034 None] Created volume successfully.
Sep 06 17:05:22 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a 1073741824" returned: 0 in 0.530s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:22 devstack sudo[97144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a
Sep 06 17:05:22 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:23 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a" returned: 0 in 0.279s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7192053b-0a21-40c3-aac5-a584f35e3491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f000b040-1f8f-4419-9407-996b1104d205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:23 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Volume volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a (726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a): created successfully
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f000b040-1f8f-4419-9407-996b1104d205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Flow 'volume_create_manager' (a99caf70-fdb6-4a8c-8295-4b78454d48dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:23 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0db177b0-b7c1-4c26-b246-e6a67cad5bd5 tempest-AttachVolumeNegativeTest-543811115 None] Created volume successfully.
Sep 06 17:05:23 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51" returned: 0 in 1.826s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_uq9g5afvdevstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:05:23 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Converted 112.00 MB image at 61.28 MB/s
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Acquiring lock "cinder-90b14b57-0c64-4d1a-876c-543f152ae5f5-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:23 devstack sudo[97150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 1G
Sep 06 17:05:23 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Lock "cinder-90b14b57-0c64-4d1a-876c-543f152ae5f5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Acquiring lock "cinder-quobyte-90b14b57-0c64-4d1a-876c-543f152ae5f5" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Lock "cinder-quobyte-90b14b57-0c64-4d1a-876c-543f152ae5f5" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8e2841-b4be-412f-9a49-ece01b096d82]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:23 devstack sudo[97152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5
Sep 06 17:05:23 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:23 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 1G" returned: 0 in 0.425s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Downloaded image 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume 2fafcbca-3e09-4d56-ae9a-d40f784c6c51 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf for user c9c83394dbed44608893a3c36c1bf3c8 is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Marking volume 2fafcbca-3e09-4d56-ae9a-d40f784c6c51 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Copying metadata from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf to 2fafcbca-3e09-4d56-ae9a-d40f784c6c51. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Creating volume glance metadata for volume 2fafcbca-3e09-4d56-ae9a-d40f784c6c51 backed by image 23f4b67c-17a9-402c-a0ff-7560fceb54cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:05:23 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5" returned: 0 in 0.407s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095ea660-fbd7-4ef7-a2b8-fd423570f54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008da47d0>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81010f3c-0f3a-471c-88f8-01b025c8713d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:24 devstack sudo[97169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5
Sep 06 17:05:24 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:24 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Volume volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 (2fafcbca-3e09-4d56-ae9a-d40f784c6c51): created successfully
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81010f3c-0f3a-471c-88f8-01b025c8713d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (edeadab1-f57f-427e-a55f-4602a4b861db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a9fe4dbe-e922-40bf-af43-4ccd66b2b88d tempest-VolumesGetTest-1302899881 None] Created volume successfully.
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ff9c76e1-6e07-4cc6-ba17-09ea0d03dc9e req-c729023d-86c6-49b8-8a47-f236381b2787 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ff9c76e1-6e07-4cc6-ba17-09ea0d03dc9e req-c729023d-86c6-49b8-8a47-f236381b2787 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ff9c76e1-6e07-4cc6-ba17-09ea0d03dc9e req-c729023d-86c6-49b8-8a47-f236381b2787 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ff9c76e1-6e07-4cc6-ba17-09ea0d03dc9e req-c729023d-86c6-49b8-8a47-f236381b2787 tempest-AttachVolumeNegativeTest-543811115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f617a471-6cac-4764-852d-faa942f84a2e', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:05:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-ff9c76e1-6e07-4cc6-ba17-09ea0d03dc9e req-c729023d-86c6-49b8-8a47-f236381b2787 tempest-AttachVolumeNegativeTest-543811115 None] attachment_update completed successfully.
Sep 06 17:05:24 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-90b14b57-0c64-4d1a-876c-543f152ae5f5" returned: 0 in 0.286s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Lock "cinder-quobyte-90b14b57-0c64-4d1a-876c-543f152ae5f5" released by "delete_volume" :: held 0.747s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Created reservations ['dd0b84ae-5886-4957-a8cb-14f9b98c871a', '63aced8c-fbc2-45ba-9f36-0dc1f34f9dfd', '5c50483e-136e-4ff7-abc5-0fbdabaeab08', 'f9f22c0a-d592-4618-a6e8-4692d253a0bb'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:24 devstack sudo[97219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:24 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:24 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.279s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Deleted volume successfully.
Sep 06 17:05:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-259c5a4e-32b5-4760-9e94-b05329747564 tempest-AbsoluteLimitsTests-2127111034 None] Lock "cinder-90b14b57-0c64-4d1a-876c-543f152ae5f5-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (3cbeb400-7298-4841-ace6-585ff330b2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cb1c65-a76f-4e5b-addb-9e493fe24069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cb1c65-a76f-4e5b-addb-9e493fe24069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1552255625',display_name='tempest-VolumesGetTest-Volume-1579149719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1fab5d-529f-486c-b0c4-e86efe00b7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:25Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f968c4ce-eb0c-4b88-98ea-0993fb579cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f968c4ce-eb0c-4b88-98ea-0993fb579cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e675b7-54eb-4938-90f2-356bf6e4d8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e675b7-54eb-4938-90f2-356bf6e4d8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1fab5d-529f-486c-b0c4-e86efe00b7a5', 'volume_name': 'volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2eed9bb-93c0-455e-9251-ade02fe6e1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2eed9bb-93c0-455e-9251-ade02fe6e1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4788459e-0e22-448d-b295-393a36639c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:25 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Volume ce1fab5d-529f-486c-b0c4-e86efe00b7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5', 'volume_size': 1}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1552255625',display_name='tempest-VolumesGetTest-Volume-1579149719',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce1fab5d-529f-486c-b0c4-e86efe00b7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f03e9f87d4144654b2b8e5be36b1d151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:25Z,use_quota=True,user_id='c9c83394dbed44608893a3c36c1bf3c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Creating volume ce1fab5d-529f-486c-b0c4-e86efe00b7a5 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:25 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:25 devstack sudo[97559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5 1073741824
Sep 06 17:05:25 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:25 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5 1073741824" returned: 0 in 0.416s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:25 devstack sudo[97565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5
Sep 06 17:05:25 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:26 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5" returned: 0 in 0.267s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4788459e-0e22-448d-b295-393a36639c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fd5e58-929f-4d51-a90d-92687309ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:26 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Volume volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5 (ce1fab5d-529f-486c-b0c4-e86efe00b7a5): created successfully
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fd5e58-929f-4d51-a90d-92687309ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:26 devstack sudo[97568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:26 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Flow 'volume_create_manager' (3cbeb400-7298-4841-ace6-585ff330b2bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:26 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-143c9725-1591-42eb-b51f-11064ae44b12 tempest-VolumesGetTest-1302899881 None] Created volume successfully.
Sep 06 17:05:26 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-ce1fab5d-529f-486c-b0c4-e86efe00b7a5-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.373s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Lock "cinder-ce1fab5d-529f-486c-b0c4-e86efe00b7a5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-quobyte-ce1fab5d-529f-486c-b0c4-e86efe00b7a5" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-ce1fab5d-529f-486c-b0c4-e86efe00b7a5" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f40604-194d-4a52-a8a1-1ff65a0a3af2]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:26 devstack sudo[97573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5
Sep 06 17:05:26 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-27fc3607-cccf-434f-9ee2-7f27b1c94531 req-1b08d3a0-992c-4e01-b516-b451120fe1c7 tempest-AttachVolumeNegativeTest-543811115 None] Terminate volume connection completed successfully.
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-27fc3607-cccf-434f-9ee2-7f27b1c94531 req-1b08d3a0-992c-4e01-b516-b451120fe1c7 tempest-AttachVolumeNegativeTest-543811115 None] Deleting attachment f617a471-6cac-4764-852d-faa942f84a2e. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:05:27 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5" returned: 0 in 0.451s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:27 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5
Sep 06 17:05:27 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:27 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce1fab5d-529f-486c-b0c4-e86efe00b7a5" returned: 0 in 0.318s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-ce1fab5d-529f-486c-b0c4-e86efe00b7a5" released by "delete_volume" :: held 0.837s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Created reservations ['433499ff-1891-499a-b94c-d6f31d6eb3bd', '2435ac9c-f127-4221-9cf7-d45dcc8971c1', '91e19999-9410-48ee-86c3-fe8986df2246', 'cfa1f3db-e69d-4509-ade3-de1886829d3f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:27 devstack sudo[97607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:27 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-2fafcbca-3e09-4d56-ae9a-d40f784c6c51-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Lock "cinder-2fafcbca-3e09-4d56-ae9a-d40f784c6c51-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:27 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.325s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Acquiring lock "cinder-quobyte-2fafcbca-3e09-4d56-ae9a-d40f784c6c51" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Deleted volume successfully.
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b882280d-26f1-430f-b660-ef48b3074987 tempest-VolumesGetTest-1302899881 None] Lock "cinder-ce1fab5d-529f-486c-b0c4-e86efe00b7a5-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-2fafcbca-3e09-4d56-ae9a-d40f784c6c51" acquired by "delete_volume" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4063b50b-39c6-4c70-858f-9943ee34e19c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:28 devstack sudo[97610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51
Sep 06 17:05:28 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:28 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51" returned: 0 in 0.515s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:28 devstack sudo[97625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51
Sep 06 17:05:28 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:28 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2fafcbca-3e09-4d56-ae9a-d40f784c6c51" returned: 0 in 0.479s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Lock "cinder-quobyte-2fafcbca-3e09-4d56-ae9a-d40f784c6c51" released by "delete_volume" :: held 1.052s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Created reservations ['5de20491-7d48-403b-9312-e76e0709cede', '2939d0cc-179a-4547-bc99-bd243de0c1d1', '39d173f8-9da4-4abe-b428-99f2b5113707', 'f7115b1c-f098-4a7d-9077-53b7fa4241c8'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:29 devstack sudo[97640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:29 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:29 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.306s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:29 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Deleted volume successfully.
Sep 06 17:05:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-17d84fbc-9176-491c-81a7-896c8de9aaa0 tempest-VolumesGetTest-1302899881 None] Lock "cinder-2fafcbca-3e09-4d56-ae9a-d40f784c6c51-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:30 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Flow 'volume_create_manager' (7239dd58-7d90-470e-add1-53657f9ca9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4cfdd0-00d4-4842-8a9a-f261e4b01880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4cfdd0-00d4-4842-8a9a-f261e4b01880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-890398007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fa6521-4973-4b9a-b032-cbf804568391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9e3ada3fb24d13bd46eb9caa4cd56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:31Z,use_quota=True,user_id='49d953f3f7c143f7a60e92f59cdac344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addf344c-1c10-4351-bbd4-f1f408f19f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addf344c-1c10-4351-bbd4-f1f408f19f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd110d1-358c-4d8c-9b07-3ae2319cbd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd110d1-358c-4d8c-9b07-3ae2319cbd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fa6521-4973-4b9a-b032-cbf804568391', 'volume_name': 'volume-a4fa6521-4973-4b9a-b032-cbf804568391', 'volume_size': 2}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d6d565-9e26-465f-b5af-b52a6f58b88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d6d565-9e26-465f-b5af-b52a6f58b88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b27295c-cb50-4efd-ba75-00b64a72eb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:31 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Volume a4fa6521-4973-4b9a-b032-cbf804568391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fa6521-4973-4b9a-b032-cbf804568391', 'volume_size': 2}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-890398007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fa6521-4973-4b9a-b032-cbf804568391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9e3ada3fb24d13bd46eb9caa4cd56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:31Z,use_quota=True,user_id='49d953f3f7c143f7a60e92f59cdac344',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Creating volume a4fa6521-4973-4b9a-b032-cbf804568391 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:31 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391 2147483648 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:31 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391 2147483648
Sep 06 17:05:31 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:31 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391 2147483648" returned: 0 in 0.597s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:31 devstack sudo[97653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391
Sep 06 17:05:31 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:32 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391" returned: 0 in 0.330s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b27295c-cb50-4efd-ba75-00b64a72eb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fa6521-4973-4b9a-b032-cbf804568391', 'volume_size': 2}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4117746f-e37f-4905-ae8f-c0fc39443330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Volume volume-a4fa6521-4973-4b9a-b032-cbf804568391 (a4fa6521-4973-4b9a-b032-cbf804568391): created successfully
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4117746f-e37f-4905-ae8f-c0fc39443330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Flow 'volume_create_manager' (7239dd58-7d90-470e-add1-53657f9ca9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "cinder-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:32 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-535db6f6-75fc-4dac-82e2-f44130fed322 tempest-VolumesCloneNegativeTest-587945635 None] Created volume successfully.
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "cinder-quobyte-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-quobyte-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[588527cb-5336-4f17-97d8-7ab509d61605]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:32 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a
Sep 06 17:05:32 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:32 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a" returned: 0 in 0.384s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:32 devstack sudo[97661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a
Sep 06 17:05:32 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:32 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-quobyte-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a" released by "delete_volume" :: held 0.699s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:32 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Created reservations ['273cbae9-a508-4fde-9ef9-6feec9b195af', 'c8b2b0f8-fc1a-4f35-ae00-5934c5a3cd88', 'b9ffd528-ef91-4e23-933d-fee7a05b49c1', '2302f484-274a-499f-9a1d-d1bcd1f4a8d5'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:33 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:33 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Acquiring lock "cinder-a4fa6521-4973-4b9a-b032-cbf804568391-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Lock "cinder-a4fa6521-4973-4b9a-b032-cbf804568391-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Acquiring lock "cinder-quobyte-a4fa6521-4973-4b9a-b032-cbf804568391" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Lock "cinder-quobyte-a4fa6521-4973-4b9a-b032-cbf804568391" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9602e727-7368-441d-a8fa-4b47644f33d5]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:33 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.367s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Deleted volume successfully.
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "cinder-6750f848-3c91-46c1-9294-361cc04dad05-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d3528ed3-ff01-4c64-a302-0475df89ce45 tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-726bf7c7-40ae-4ff8-8a9b-9f3753b8c36a-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-6750f848-3c91-46c1-9294-361cc04dad05-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "cinder-quobyte-6750f848-3c91-46c1-9294-361cc04dad05" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:33 devstack sudo[97667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391
Sep 06 17:05:33 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-quobyte-6750f848-3c91-46c1-9294-361cc04dad05" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd15a35-ad95-4c81-9d0e-dcbee3a84fb9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:33 devstack sudo[97669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05
Sep 06 17:05:33 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:33 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391" returned: 0 in 0.450s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:33 devstack sudo[97674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391
Sep 06 17:05:33 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:33 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05" returned: 0 in 0.393s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:33 devstack sudo[97679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05
Sep 06 17:05:33 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:34 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a4fa6521-4973-4b9a-b032-cbf804568391" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Lock "cinder-quobyte-a4fa6521-4973-4b9a-b032-cbf804568391" released by "delete_volume" :: held 0.780s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Created reservations ['cab0a892-bac8-4a08-96f0-41baf42d98b7', 'c3b338b0-5fc7-4a3b-90af-f36342158453', '4c410769-ed18-468b-aa57-90d5822f09a2', '7daf8254-e42c-4582-95f8-212db509b21a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:34 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6750f848-3c91-46c1-9294-361cc04dad05" returned: 0 in 0.295s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-quobyte-6750f848-3c91-46c1-9294-361cc04dad05" released by "delete_volume" :: held 0.752s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Created reservations ['98747ef7-25f7-4ad2-aa7a-46a140d63810', '1b1520d7-f8e4-428d-9873-af3bbb549130', '67500765-e9bc-4acd-bda7-36380494baba', 'bc4b7233-0bda-4401-9608-b9f0e7427296'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:34 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:34 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:34 devstack sudo[97685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:34 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Flow 'volume_create_manager' (f3d4fbcc-aa8a-4af9-a978-7f887f96f6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d6eac7-e18c-42a0-9e58-1b1acaadcf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:34 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d6eac7-e18c-42a0-9e58-1b1acaadcf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-114518522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='667fe05b5a574b8cbaa401472c15f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:35Z,use_quota=True,user_id='07edf93db7f94efcaa265ccfa0874d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9640d9b7-f55b-40e0-815d-e6fd471643ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9640d9b7-f55b-40e0-815d-e6fd471643ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e2c145-328c-4c68-b490-cba955c548c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e2c145-328c-4c68-b490-cba955c548c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a', 'volume_name': 'volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5977a814-b008-44bd-9dd7-c40f18d630c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5977a814-b008-44bd-9dd7-c40f18d630c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af339ed-dad9-40ce-9c65-bca9f30d89f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Volume 1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a', 'volume_size': 1}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-114518522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='667fe05b5a574b8cbaa401472c15f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:35Z,use_quota=True,user_id='07edf93db7f94efcaa265ccfa0874d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Creating volume 1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:34 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "cinder-ba358da2-1012-47f8-a9b1-07e6d160848a-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.453s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Deleted volume successfully.
Sep 06 17:05:34 devstack sudo[97689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a 1073741824
Sep 06 17:05:34 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-ba358da2-1012-47f8-a9b1-07e6d160848a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:34 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1094c58-9ab0-46c1-bbcf-6c4a0f5115b3 tempest-VolumesCloneNegativeTest-587945635 None] Lock "cinder-a4fa6521-4973-4b9a-b032-cbf804568391-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.368s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Deleted volume successfully.
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "cinder-quobyte-ba358da2-1012-47f8-a9b1-07e6d160848a" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9f24368b-5f8d-4d27-96bb-fecb252bdf9a tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-6750f848-3c91-46c1-9294-361cc04dad05-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-quobyte-ba358da2-1012-47f8-a9b1-07e6d160848a" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[baccd05a-a320-4d67-963d-fc6ee2e4ec77]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:35 devstack sudo[97691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a
Sep 06 17:05:35 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:35 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a 1073741824" returned: 0 in 0.529s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:35 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a" returned: 0 in 0.385s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:35 devstack sudo[97699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a
Sep 06 17:05:35 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:35 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a
Sep 06 17:05:35 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:35 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ba358da2-1012-47f8-a9b1-07e6d160848a" returned: 0 in 0.297s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:35 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a" returned: 0 in 0.275s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-quobyte-ba358da2-1012-47f8-a9b1-07e6d160848a" released by "delete_volume" :: held 0.732s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af339ed-dad9-40ce-9c65-bca9f30d89f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010b4d4d-9ce9-42df-be14-461e0671e78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Volume volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a (1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a): created successfully
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010b4d4d-9ce9-42df-be14-461e0671e78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Flow 'volume_create_manager' (f3d4fbcc-aa8a-4af9-a978-7f887f96f6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7c76abab-9e8a-408c-bfcc-e1af86804dc2 tempest-VolumesListTestJSON-418238726 None] Created volume successfully.
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Created reservations ['1bb735e7-62be-4d9f-868e-df0f391ecf7c', 'ef59b28a-5908-46ea-96f9-4882755ff058', 'b9f94c29-aeec-4c94-852e-a9697c89a84d', '086c67b3-5324-4a69-a135-d3c4194b9275'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:35 devstack sudo[97705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:35 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:36 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:36 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Deleted volume successfully.
Sep 06 17:05:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3fb08f12-6eb2-49f7-b55e-bc1d7a818f83 tempest-AttachVolumeNegativeTest-543811115 None] Lock "cinder-ba358da2-1012-47f8-a9b1-07e6d160848a-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Flow 'volume_create_manager' (2dcaecc7-1eff-492e-9903-e1383b8d77dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de9ad39-970e-4b9d-85fa-71d933e24c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de9ad39-970e-4b9d-85fa-71d933e24c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1061888233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b3440d-8268-452f-a35a-400bb9ded52d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='667fe05b5a574b8cbaa401472c15f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:37Z,use_quota=True,user_id='07edf93db7f94efcaa265ccfa0874d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67fadad-ee8c-4d8f-b12b-10db6548a2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e67fadad-ee8c-4d8f-b12b-10db6548a2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe4bb8f-f5a4-4319-8f74-0d8e05fd884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe4bb8f-f5a4-4319-8f74-0d8e05fd884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b3440d-8268-452f-a35a-400bb9ded52d', 'volume_name': 'volume-e2b3440d-8268-452f-a35a-400bb9ded52d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115a15a5-7fdd-4b23-969d-f0f9e909e0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115a15a5-7fdd-4b23-969d-f0f9e909e0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1484981-c597-4c1a-815e-136b0521d2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:37 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Volume e2b3440d-8268-452f-a35a-400bb9ded52d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b3440d-8268-452f-a35a-400bb9ded52d', 'volume_size': 1}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1061888233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b3440d-8268-452f-a35a-400bb9ded52d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='667fe05b5a574b8cbaa401472c15f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:37Z,use_quota=True,user_id='07edf93db7f94efcaa265ccfa0874d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Creating volume e2b3440d-8268-452f-a35a-400bb9ded52d {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:37 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:37 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d 1073741824
Sep 06 17:05:37 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:37 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d 1073741824" returned: 0 in 0.508s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:38 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d
Sep 06 17:05:38 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:38 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d" returned: 0 in 0.274s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1484981-c597-4c1a-815e-136b0521d2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b3440d-8268-452f-a35a-400bb9ded52d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ec2062-9ef2-4c82-ba05-72f236003837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:38 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Volume volume-e2b3440d-8268-452f-a35a-400bb9ded52d (e2b3440d-8268-452f-a35a-400bb9ded52d): created successfully
Sep 06 17:05:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ec2062-9ef2-4c82-ba05-72f236003837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Flow 'volume_create_manager' (2dcaecc7-1eff-492e-9903-e1383b8d77dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ba3bc681-ec1b-4657-b974-a89aebd400e2 tempest-VolumesListTestJSON-418238726 None] Created volume successfully.
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Flow 'volume_create_manager' (c3be045c-464f-4c98-9b08-1ba2e09ae689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5185e1-0a47-4522-a7d8-05691ae1d6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f5185e1-0a47-4522-a7d8-05691ae1d6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1817080151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c8dea6-39fe-44bc-adeb-1a0218bc1768,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='667fe05b5a574b8cbaa401472c15f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:40Z,use_quota=True,user_id='07edf93db7f94efcaa265ccfa0874d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c421cd-0f94-48ec-bae7-5000a031e80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c421cd-0f94-48ec-bae7-5000a031e80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d49af2-cc6a-4350-aca2-c63216319a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d49af2-cc6a-4350-aca2-c63216319a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c8dea6-39fe-44bc-adeb-1a0218bc1768', 'volume_name': 'volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270f7d16-6a17-4ef0-9115-20fadc4d5ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270f7d16-6a17-4ef0-9115-20fadc4d5ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2925bbe9-f4c2-4056-8fac-0cb68bef09d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:40 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Volume f6c8dea6-39fe-44bc-adeb-1a0218bc1768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768', 'volume_size': 1}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1817080151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c8dea6-39fe-44bc-adeb-1a0218bc1768,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='667fe05b5a574b8cbaa401472c15f889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:40Z,use_quota=True,user_id='07edf93db7f94efcaa265ccfa0874d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Creating volume f6c8dea6-39fe-44bc-adeb-1a0218bc1768 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:40 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:40 devstack sudo[97718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768 1073741824
Sep 06 17:05:40 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:40 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768 1073741824" returned: 0 in 0.511s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:40 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768
Sep 06 17:05:40 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:41 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768" returned: 0 in 0.302s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2925bbe9-f4c2-4056-8fac-0cb68bef09d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa332ba-c479-4ec4-8ac6-61abb2562d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:41 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Volume volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768 (f6c8dea6-39fe-44bc-adeb-1a0218bc1768): created successfully
Sep 06 17:05:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa332ba-c479-4ec4-8ac6-61abb2562d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Flow 'volume_create_manager' (c3be045c-464f-4c98-9b08-1ba2e09ae689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ac9d1cc3-0fdd-4041-b58b-635d9ce308ee tempest-VolumesListTestJSON-418238726 None] Created volume successfully.
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Flow 'volume_create_manager' (58354697-68bf-494d-8868-beb50f1755b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0aa424-e62e-446d-a4c4-d92ec46833bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0aa424-e62e-446d-a4c4-d92ec46833bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1524961010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06312627-a0f1-4865-b3cd-877c96c72ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2bf9a67a4e41a6b41cdad561389b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:42Z,use_quota=True,user_id='2bd24f7dc6a04832a076c2ef7d26532a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764f3873-9f07-4f13-b755-82fbd9d1b39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764f3873-9f07-4f13-b755-82fbd9d1b39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea97c0c-f79f-4358-8e29-82f2e98b823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea97c0c-f79f-4358-8e29-82f2e98b823b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06312627-a0f1-4865-b3cd-877c96c72ff7', 'volume_name': 'volume-06312627-a0f1-4865-b3cd-877c96c72ff7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3719273e-3e01-4ef6-9cb5-e3f50c06621e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3719273e-3e01-4ef6-9cb5-e3f50c06621e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474ad6fc-f733-46a2-881c-d01d1411cf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:42 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Volume 06312627-a0f1-4865-b3cd-877c96c72ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06312627-a0f1-4865-b3cd-877c96c72ff7', 'volume_size': 1}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1524961010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06312627-a0f1-4865-b3cd-877c96c72ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e2bf9a67a4e41a6b41cdad561389b87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:42Z,use_quota=True,user_id='2bd24f7dc6a04832a076c2ef7d26532a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Creating volume 06312627-a0f1-4865-b3cd-877c96c72ff7 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:42 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:42 devstack sudo[97729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7 1073741824
Sep 06 17:05:42 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:42 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7 1073741824" returned: 0 in 0.505s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:42 devstack sudo[97735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7
Sep 06 17:05:42 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:43 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7" returned: 0 in 0.282s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (474ad6fc-f733-46a2-881c-d01d1411cf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06312627-a0f1-4865-b3cd-877c96c72ff7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5018e665-28d7-4f95-aede-bd6d97abf5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:43 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Volume volume-06312627-a0f1-4865-b3cd-877c96c72ff7 (06312627-a0f1-4865-b3cd-877c96c72ff7): created successfully
Sep 06 17:05:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5018e665-28d7-4f95-aede-bd6d97abf5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Flow 'volume_create_manager' (58354697-68bf-494d-8868-beb50f1755b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-63c80f93-308d-4702-86da-f4782fc8fefe tempest-VolumesNegativeTest-1453155736 None] Created volume successfully.
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Flow 'volume_create_manager' (c4af8156-bc0f-4bf4-8ff1-64e69498154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bab7bc6-b291-4333-9ff2-713e1e1c1e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bab7bc6-b291-4333-9ff2-713e1e1c1e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1694707619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb9b57c-da06-4f61-8f3f-f1e95dc4741f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1246977aceb54ebba3893b13b1a4860f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:44Z,use_quota=True,user_id='60489adeeca647cbb4c697e300d6b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28da95af-5fcb-4304-a991-a93974c46687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28da95af-5fcb-4304-a991-a93974c46687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53c84ab-562d-4d02-b637-e4539b5b0d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e53c84ab-562d-4d02-b637-e4539b5b0d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb9b57c-da06-4f61-8f3f-f1e95dc4741f', 'volume_name': 'volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0487d4fe-0d8e-47fe-81dd-eb46d0848d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0487d4fe-0d8e-47fe-81dd-eb46d0848d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d350b9-2424-4cf4-ac7f-a99a38e0e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:44 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Volume 6eb9b57c-da06-4f61-8f3f-f1e95dc4741f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f', 'volume_size': 1}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1694707619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb9b57c-da06-4f61-8f3f-f1e95dc4741f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1246977aceb54ebba3893b13b1a4860f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:05:44Z,use_quota=True,user_id='60489adeeca647cbb4c697e300d6b3ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Creating volume 6eb9b57c-da06-4f61-8f3f-f1e95dc4741f {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:05:44 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:44 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f 1073741824
Sep 06 17:05:44 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Acquiring lock "cinder-f6c8dea6-39fe-44bc-adeb-1a0218bc1768-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Lock "cinder-f6c8dea6-39fe-44bc-adeb-1a0218bc1768-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Acquiring lock "cinder-quobyte-f6c8dea6-39fe-44bc-adeb-1a0218bc1768" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Lock "cinder-quobyte-f6c8dea6-39fe-44bc-adeb-1a0218bc1768" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf74c5b1-4059-404f-97fd-e30e68870fe7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:44 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f 1073741824" returned: 0 in 0.523s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:45 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f
Sep 06 17:05:45 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:45 devstack sudo[97745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768
Sep 06 17:05:45 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:45 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f" returned: 0 in 0.275s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d350b9-2424-4cf4-ac7f-a99a38e0e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93dd9c04-6d32-445a-9db4-a448abf7405a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:05:45 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Volume volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f (6eb9b57c-da06-4f61-8f3f-f1e95dc4741f): created successfully
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93dd9c04-6d32-445a-9db4-a448abf7405a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Flow 'volume_create_manager' (c4af8156-bc0f-4bf4-8ff1-64e69498154a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:05:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-ba4bc7b4-2ea0-4456-8bb5-0bf1415b760d req-fc96dc3d-f82a-4c8e-b0cf-f118e50511c5 tempest-VolumesGetTestJSON-174566125 None] Created volume successfully.
Sep 06 17:05:45 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768" returned: 0 in 0.469s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:45 devstack sudo[97756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768
Sep 06 17:05:45 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Acquiring lock "cinder-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Lock "cinder-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:45 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f6c8dea6-39fe-44bc-adeb-1a0218bc1768" returned: 0 in 0.334s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Lock "cinder-quobyte-f6c8dea6-39fe-44bc-adeb-1a0218bc1768" released by "delete_volume" :: held 0.847s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Acquiring lock "cinder-quobyte-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Lock "cinder-quobyte-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e670749-af97-4987-9efc-46139463fc3b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Created reservations ['7ecd5677-8ff9-4880-bf0d-a5bfe9d8922e', '6861b66f-05ee-4597-8e99-498f8ebe5ead', '95cae2b2-7a01-443c-88aa-5888953d1038', 'ed717c99-a0c3-4d2a-b530-0063d5343c60'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:45 devstack sudo[97759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f
Sep 06 17:05:45 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:45 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:46 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "cinder-e2b3440d-8268-452f-a35a-400bb9ded52d-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Lock "cinder-e2b3440d-8268-452f-a35a-400bb9ded52d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "cinder-quobyte-e2b3440d-8268-452f-a35a-400bb9ded52d" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Lock "cinder-quobyte-e2b3440d-8268-452f-a35a-400bb9ded52d" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f111351f-bd81-4a25-99cd-2fcbea8c0947]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:46 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.339s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:46 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Deleted volume successfully.
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8036c7a6-f061-43f7-962f-e2944ca99b3f tempest-VolumesListTestJSON-418238726 None] Lock "cinder-f6c8dea6-39fe-44bc-adeb-1a0218bc1768-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:46 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f" returned: 0 in 0.553s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:46 devstack sudo[97769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f
Sep 06 17:05:46 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:46 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d
Sep 06 17:05:46 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:46 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f" returned: 0 in 0.306s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Lock "cinder-quobyte-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f" released by "delete_volume" :: held 0.902s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:46 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d" returned: 0 in 0.504s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:46 devstack sudo[97776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d
Sep 06 17:05:46 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.quota [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Created reservations ['d3d2b783-2442-4ba8-b362-6215cddea742', '78f0318f-c158-4bd8-bafe-f6d874c0fea7', 'c29f985e-93b5-4d97-960e-778136ba0864', 'b33683fb-3b43-4812-878a-4ebecd82e194'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:46 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:46 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:47 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2b3440d-8268-452f-a35a-400bb9ded52d" returned: 0 in 0.339s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Lock "cinder-quobyte-e2b3440d-8268-452f-a35a-400bb9ded52d" released by "delete_volume" :: held 0.917s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Created reservations ['a99ed1d7-2879-49fa-96a7-36027ac22f9c', 'f73840ac-6624-4ef7-a871-f0b343b279e6', '4262e4c0-72b6-4612-8727-0464218d51f2', '1d0c37d6-ec75-44fe-a539-27b8268e359f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:47 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG cinder.manager [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:47 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Deleted volume successfully.
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5e68c9b9-811f-49b1-9669-9ee93533d009 req-383b0efa-dfdd-40ec-99cd-45ffa552d46d tempest-VolumesGetTestJSON-174566125 None] Lock "cinder-6eb9b57c-da06-4f61-8f3f-f1e95dc4741f-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:47 devstack sudo[97786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:47 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:47 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.286s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:47 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Deleted volume successfully.
Sep 06 17:05:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e179f155-8287-4783-9558-5eddf5bec6b1 tempest-VolumesListTestJSON-418238726 None] Lock "cinder-e2b3440d-8268-452f-a35a-400bb9ded52d-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "cinder-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Lock "cinder-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "cinder-quobyte-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:05:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Lock "cinder-quobyte-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:05:48 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4e6f88-83ef-4270-a480-c6e6bb1a7f2d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:05:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:48 devstack sudo[97801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a
Sep 06 17:05:48 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:49 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a" returned: 0 in 0.417s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:49 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a
Sep 06 17:05:49 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:49 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a" returned: 0 in 0.326s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Lock "cinder-quobyte-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a" released by "delete_volume" :: held 0.795s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Created reservations ['d01e4d07-5660-424d-8fc6-6f4a1f773209', '0932b62e-c4a6-424a-872d-8c188e07fe57', 'e8bcfe91-7b80-4883-9d42-00b092dd647b', '0a926d7b-0a58-4c24-97d3-7623884f6275'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:05:49 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:05:49 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:05:49 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.435s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:05:49 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Deleted volume successfully.
Sep 06 17:05:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f2483df2-e622-48b5-b4b6-8df6fac089c1 tempest-VolumesListTestJSON-418238726 None] Lock "cinder-1cfa94f4-83cf-40fa-a2b7-b7d5a8299b6a-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:05:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8204289e-0376-475c-9992-1fdaa4af8564 tempest-BackendsCapabilitiesAdminTestsJSON-398835842 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6612968444824, 'free_capacity_gb': 1773.6612968444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87474) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 06 17:05:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b9958eba-cb0a-4b20-af16-28d0e6fb75d6 tempest-BackendsCapabilitiesAdminTestsJSON-398835842 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6612968444824, 'free_capacity_gb': 1773.6612968444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87474) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 06 17:05:59 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:DELETE=11,cinder:SELECT=87,cinder:INSERT=33,cinder:UPDATE=135 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:05:59 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=101,cinder:INSERT=38,cinder:UPDATE=123,cinder:DELETE=12 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:06:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-079da454-a41e-40ef-bfb6-a33a82aba721 tempest-GroupSnapshotsTest-1302474336 None] Group tempest-GroupSnapshotsTest-Group-1849718677: creating
Sep 06 17:06:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-079da454-a41e-40ef-bfb6-a33a82aba721 tempest-GroupSnapshotsTest-1302474336 None] Group tempest-GroupSnapshotsTest-Group-1849718677: created successfully
Sep 06 17:06:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-079da454-a41e-40ef-bfb6-a33a82aba721 tempest-GroupSnapshotsTest-1302474336 None] Create group completed successfully.
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Flow 'volume_create_manager' (90125568-014b-466c-964d-9a47416b3538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2700f9-d1f6-4be3-9e43-72f7ecf0869c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2700f9-d1f6-4be3-9e43-72f7ecf0869c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052074186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6fbc1a4c-74bd-48ae-9c95-20a7692a3243,host='devstack@QuobyteHD#QuobyteHD',id=462ba17f-555e-43bf-9be4-6b3b5e9ec242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8220ec4d831848c2b7697bfd058e02a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:03Z,use_quota=True,user_id='7db63b5f9fec4987a6a59773c9a6d18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67bd99d9-10e4-4969-91f3-b6e6ed65bfe8),volume_type_id=67bd99d9-10e4-4969-91f3-b6e6ed65bfe8)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628dcf59-12a3-44c5-bdc5-21196fce4d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628dcf59-12a3-44c5-bdc5-21196fce4d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e209deb7-8b1a-4b97-92db-a29ea4ce056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e209deb7-8b1a-4b97-92db-a29ea4ce056e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '462ba17f-555e-43bf-9be4-6b3b5e9ec242', 'volume_name': 'volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb45b568-d618-461c-bd45-ea192e74f9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb45b568-d618-461c-bd45-ea192e74f9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60e86fb-3405-4feb-8a33-b01e47c7e3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Volume 462ba17f-555e-43bf-9be4-6b3b5e9ec242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242', 'volume_size': 1}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6fbc1a4c-74bd-48ae-9c95-20a7692a3243,created_at=2026-09-06T15:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2052074186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6fbc1a4c-74bd-48ae-9c95-20a7692a3243,host='devstack@QuobyteHD#QuobyteHD',id=462ba17f-555e-43bf-9be4-6b3b5e9ec242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8220ec4d831848c2b7697bfd058e02a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:03Z,use_quota=True,user_id='7db63b5f9fec4987a6a59773c9a6d18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67bd99d9-10e4-4969-91f3-b6e6ed65bfe8),volume_type_id=67bd99d9-10e4-4969-91f3-b6e6ed65bfe8)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Creating volume 462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:02 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:06:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:02 devstack sudo[97947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 1073741824
Sep 06 17:06:02 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:03 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 1073741824" returned: 0 in 0.506s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:03 devstack sudo[97953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242
Sep 06 17:06:03 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:03 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242" returned: 0 in 0.332s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:06:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60e86fb-3405-4feb-8a33-b01e47c7e3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f9974-cd72-405d-a419-d01a2bb051ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:03 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Volume volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 (462ba17f-555e-43bf-9be4-6b3b5e9ec242): created successfully
Sep 06 17:06:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6f9974-cd72-405d-a419-d01a2bb051ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Flow 'volume_create_manager' (90125568-014b-466c-964d-9a47416b3538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:03 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5711fcca-372e-40c1-82fe-f833cc68e540 tempest-GroupSnapshotsTest-1302474336 None] Created volume successfully.
Sep 06 17:06:04 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] GroupSnapshot aa41cfd8-4266-443d-bcf2-901355f8e41b: creating.
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Group snapshot aa41cfd8-4266-443d-bcf2-901355f8e41b: creating. {{(pid=87474) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Creating offline snapshot ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 of volume 462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9c1d81-29ac-4285-82a4-798a44a003bc]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Acquiring lock "cinder-06312627-a0f1-4865-b3cd-877c96c72ff7-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Lock "cinder-06312627-a0f1-4865-b3cd-877c96c72ff7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:04 devstack sudo[97956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Acquiring lock "cinder-quobyte-06312627-a0f1-4865-b3cd-877c96c72ff7" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:04 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Lock "cinder-quobyte-06312627-a0f1-4865-b3cd-877c96c72ff7" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dea645e-4fd1-4775-9f55-718098f39196]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:05 devstack sudo[97958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7
Sep 06 17:06:05 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:05 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242" returned: 0 in 0.457s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:05 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 1G
Sep 06 17:06:05 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:05 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7" returned: 0 in 0.424s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:05 devstack sudo[97969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7
Sep 06 17:06:05 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:05 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 1G" returned: 0 in 0.418s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:05 devstack sudo[97976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777
Sep 06 17:06:05 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:05 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-06312627-a0f1-4865-b3cd-877c96c72ff7" returned: 0 in 0.293s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Lock "cinder-quobyte-06312627-a0f1-4865-b3cd-877c96c72ff7" released by "delete_volume" :: held 0.786s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Created reservations ['6eb67a79-946d-4bd3-8099-dbf3276ab2ff', 'a34aea13-408c-46b5-bc89-928b64655716', 'eab18d19-2e4e-4caf-818c-001aa5a8bc64', '70caaa7a-3035-4189-87c9-efdefee1c66a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:05 devstack sudo[97980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:05 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:05 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777" returned: 0 in 0.309s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:05 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:06:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:05 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777
Sep 06 17:06:05 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:06 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.313s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Deleted volume successfully.
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f4e6d9e7-1c7e-4686-aa89-8d9dbd88728e tempest-VolumesNegativeTest-1453155736 None] Lock "cinder-06312627-a0f1-4865-b3cd-877c96c72ff7-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (f00da5e6-f1c1-4786-a355-b9335bea469e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b4d0eb-be3a-48ae-816a-caf51243b255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:06 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777" returned: 0 in 0.342s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b4d0eb-be3a-48ae-816a-caf51243b255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-617784238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44eed897-f42d-4ad5-a3a1-3266b999e342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b343e8fb54281b2a056a358d82811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:06Z,use_quota=True,user_id='ddc2725ed03d4a2eb69e1e4a7a77a46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95f29bb-469f-4c15-a1c1-9a4d82c4f8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c95f29bb-469f-4c15-a1c1-9a4d82c4f8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdded61-38fe-40a9-aa64-dc1f27bb7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdded61-38fe-40a9-aa64-dc1f27bb7267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44eed897-f42d-4ad5-a3a1-3266b999e342', 'volume_name': 'volume-44eed897-f42d-4ad5-a3a1-3266b999e342', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e9b00b-d032-4213-bc9a-6dcc0d02dfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e9b00b-d032-4213-bc9a-6dcc0d02dfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42db58e1-abbd-4d6d-a511-9785168a5a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:06 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Volume 44eed897-f42d-4ad5-a3a1-3266b999e342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44eed897-f42d-4ad5-a3a1-3266b999e342', 'volume_size': 1}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:06 devstack sudo[97988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.info
Sep 06 17:06:06 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:06 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.info" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:06 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:06 devstack sudo[97991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.info
Sep 06 17:06:06 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:06 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.info" returned: 0 in 0.250s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.551s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-617784238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44eed897-f42d-4ad5-a3a1-3266b999e342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b343e8fb54281b2a056a358d82811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:06Z,use_quota=True,user_id='ddc2725ed03d4a2eb69e1e4a7a77a46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Creating volume 44eed897-f42d-4ad5-a3a1-3266b999e342 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:06 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:06:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:06 devstack sudo[97994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342 1073741824
Sep 06 17:06:06 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-fb852c4a-39ca-4cad-a99d-7928afb262f5 tempest-GroupSnapshotsTest-1302474336 None] group_snapshot aa41cfd8-4266-443d-bcf2-901355f8e41b: created successfully
Sep 06 17:06:07 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342 1073741824" returned: 0 in 0.487s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:07 devstack sudo[98000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342
Sep 06 17:06:07 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:07 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342" returned: 0 in 0.252s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:06:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42db58e1-abbd-4d6d-a511-9785168a5a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44eed897-f42d-4ad5-a3a1-3266b999e342', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cff60f4-ce28-454c-9a3e-2ce1364570cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:07 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Volume volume-44eed897-f42d-4ad5-a3a1-3266b999e342 (44eed897-f42d-4ad5-a3a1-3266b999e342): created successfully
Sep 06 17:06:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cff60f4-ce28-454c-9a3e-2ce1364570cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (f00da5e6-f1c1-4786-a355-b9335bea469e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:07 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-208e5577-7c99-494e-926b-f98e54e2cea3 tempest-VolumesSnapshotTestJSON-467432576 None] Created volume successfully.
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777-e897025d-a1b5-4eac-8ca6-457502710f07" by "_create_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777-e897025d-a1b5-4eac-8ca6-457502710f07" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Creating volume e897025d-a1b5-4eac-8ca6-457502710f07 from snapshot ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 {{(pid=87474) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-e897025d-a1b5-4eac-8ca6-457502710f07" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-e897025d-a1b5-4eac-8ca6-457502710f07" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] snapshot: ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777, volume: e897025d-a1b5-4eac-8ca6-457502710f07,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4eaff2-b6ba-456a-b4b0-d03dc578a5a2]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:08 devstack sudo[98003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777
Sep 06 17:06:08 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:08 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777" returned: 0 in 0.404s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda005ac-0320-451d-94d5-8701473c25c9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:09 devstack sudo[98008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242
Sep 06 17:06:09 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:09 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242" returned: 0 in 0.418s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07 not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:09 devstack sudo[98013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07
Sep 06 17:06:09 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Flow 'volume_create_manager' (2531b6f0-26e8-4b29-a282-38b4d8e99d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea83e348-6b8e-4da4-a359-1ef8d3720b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea83e348-6b8e-4da4-a359-1ef8d3720b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1268200807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d37c66e-6bf5-4def-9679-6a91cdd25c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ea1a78698496484c93f75b59704f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:10Z,use_quota=True,user_id='bfce68f7b4794d1198adf749240ddebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06797a7-4c4c-4ad8-a34f-1dfd462fd6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b06797a7-4c4c-4ad8-a34f-1dfd462fd6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e546ec-9e7d-4088-a84f-87fc5fa9f404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e546ec-9e7d-4088-a84f-87fc5fa9f404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d37c66e-6bf5-4def-9679-6a91cdd25c49', 'volume_name': 'volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d430f7-083e-4cee-b896-653d0f250d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d430f7-083e-4cee-b896-653d0f250d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc669eb5-4c20-4597-b881-d29f8cb094fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:09 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Volume 8d37c66e-6bf5-4def-9679-6a91cdd25c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49', 'volume_size': 1}
Sep 06 17:06:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:13 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07" returned: 0 in 4.108s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242, size 1024.00 MB, duration 4.11 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:06:13 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Converted 1024.00 MB image at 249.23 MB/s
Sep 06 17:06:13 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07 is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:13 devstack sudo[98027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07
Sep 06 17:06:13 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:13 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07" returned: 0 in 0.229s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-e897025d-a1b5-4eac-8ca6-457502710f07" released by "_copy_volume_from_snapshot" :: held 5.255s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777-e897025d-a1b5-4eac-8ca6-457502710f07" released by "_create_volume_from_snapshot" :: held 5.324s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.344s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.928s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Creating offline snapshot a7b12468-c498-41dc-9d55-06b589eb41ef of volume 44eed897-f42d-4ad5-a3a1-3266b999e342 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3461bdb-701a-4f54-8613-802a28040e06]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:13 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-2e28f6dc-ffef-4b78-bc84-ee485dd0fc1d tempest-GroupSnapshotsTest-1302474336 None] Create group from source-snapshot-aa41cfd8-4266-443d-bcf2-901355f8e41b completed successfully.
Sep 06 17:06:13 devstack sudo[98030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342
Sep 06 17:06:13 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:14 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342" returned: 0 in 0.389s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:14 devstack sudo[98035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef 1G
Sep 06 17:06:14 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:14 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef 1G" returned: 0 in 0.378s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44eed897-f42d-4ad5-a3a1-3266b999e342 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:14 devstack sudo[98040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44eed897-f42d-4ad5-a3a1-3266b999e342 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef
Sep 06 17:06:14 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:14 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44eed897-f42d-4ad5-a3a1-3266b999e342 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef" returned: 0 in 0.302s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:14 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef is being set with open permissions: ugo+rw
Sep 06 17:06:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:14 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef
Sep 06 17:06:14 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:15 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-e897025d-a1b5-4eac-8ca6-457502710f07" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-e897025d-a1b5-4eac-8ca6-457502710f07" acquired by "delete_volume" :: waited 0.033s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:15 devstack sudo[98049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.info
Sep 06 17:06:15 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88cc40e-8fcb-499d-b962-5344feecb204]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:15 devstack sudo[98051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07
Sep 06 17:06:15 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:15 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.info" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:15 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.info is being set with open permissions: ugo+rw
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:15 devstack sudo[98054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.info
Sep 06 17:06:15 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:15 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07" returned: 0 in 0.367s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:15 devstack sudo[98059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07
Sep 06 17:06:15 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:15 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.info" returned: 0 in 0.243s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.058s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1268200807',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d37c66e-6bf5-4def-9679-6a91cdd25c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e9ea1a78698496484c93f75b59704f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:10Z,use_quota=True,user_id='bfce68f7b4794d1198adf749240ddebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Creating volume 8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:15 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:15 devstack sudo[98062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 1073741824
Sep 06 17:06:15 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d45ae872-5aae-4b43-836c-79d970b45aeb tempest-VolumesSnapshotTestJSON-467432576 None] Create snapshot completed successfully
Sep 06 17:06:15 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e897025d-a1b5-4eac-8ca6-457502710f07" returned: 0 in 0.239s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-e897025d-a1b5-4eac-8ca6-457502710f07" released by "delete_volume" :: held 0.658s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:15 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['d7412401-96e7-4134-921d-7af7193e8620'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:15 devstack cinder-volume[87474]: WARNING cinder.quota [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1702116318 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1702116318, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:06:15 devstack cinder-volume[87474]: WARNING cinder.quota [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1702116318 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1702116318, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['a982fcaa-1500-44b1-a7c1-895b7cfb705c', 'd2f70b62-f381-4332-ae98-c541de842a80', 'b792fad7-bdf3-4f23-82ec-6efb9dae9e22', '914fc29b-6978-4664-b836-eebacb96d755'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:16 devstack sudo[98069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:16 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:16 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 1073741824" returned: 0 in 0.477s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:16 devstack sudo[98071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49
Sep 06 17:06:16 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:16 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.292s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-a7b12468-c498-41dc-9d55-06b589eb41ef-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a1f750f0-0255-4fbe-ab45-3fc2445952bf tempest-GroupSnapshotsTest-1302474336 None] Delete group completed successfully.
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-a7b12468-c498-41dc-9d55-06b589eb41ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-44eed897-f42d-4ad5-a3a1-3266b999e342" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-44eed897-f42d-4ad5-a3a1-3266b999e342" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-a7b12468-c498-41dc-9d55-06b589eb41ef" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] group_snapshot aa41cfd8-4266-443d-bcf2-901355f8e41b: deleting
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-a7b12468-c498-41dc-9d55-06b589eb41ef" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Deleting offline snapshot a7b12468-c498-41dc-9d55-06b589eb41ef of volume 44eed897-f42d-4ad5-a3a1-3266b999e342 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] snapshot_file for this snap is: volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:16 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] group_snapshot aa41cfd8-4266-443d-bcf2-901355f8e41b: deleting {{(pid=87474) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb309154-6796-4193-a2ff-460a00e6f4b3]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49" returned: 0 in 0.299s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc669eb5-4c20-4597-b881-d29f8cb094fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a03a8c-83ab-4f7f-9f72-a629ed3d2881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-462ba17f-555e-43bf-9be4-6b3b5e9ec242" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:16 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Volume volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 (8d37c66e-6bf5-4def-9679-6a91cdd25c49): created successfully
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a03a8c-83ab-4f7f-9f72-a629ed3d2881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Flow 'volume_create_manager' (2531b6f0-26e8-4b29-a282-38b4d8e99d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-859172e9-c5be-4687-ba92-36b7757c3d8d tempest-VolumesSnapshotListTestJSON-95729072 None] Created volume successfully.
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-462ba17f-555e-43bf-9be4-6b3b5e9ec242" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Deleting offline snapshot ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 of volume 462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] snapshot_file for this snap is: volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:16 devstack sudo[98075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef
Sep 06 17:06:16 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba0f4ae-9cf7-475b-9ff4-10103d5790e7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:16 devstack sudo[98077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777
Sep 06 17:06:16 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:16 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef" returned: 0 in 0.384s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44eed897-f42d-4ad5-a3a1-3266b999e342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c3bbb3-35e1-428d-ab74-c8197c74b4de]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:17 devstack sudo[98082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342
Sep 06 17:06:17 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:17 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777" returned: 0 in 0.408s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa7d19d-02e3-491f-83f7-ca86c321a712]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:17 devstack sudo[98087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242
Sep 06 17:06:17 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:17 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342" returned: 0 in 0.395s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:17 devstack sudo[98092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef
Sep 06 17:06:17 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Creating offline snapshot cbe8aad1-a58a-4430-a733-c641f7a34ab1 of volume 8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5948fd9-823d-47cb-9868-273bd7a5031f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:17 devstack sudo[98094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49
Sep 06 17:06:17 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:17 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242" returned: 0 in 0.548s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:17 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef" returned: 0 in 0.360s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:17 devstack sudo[98102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777
Sep 06 17:06:17 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:17 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef
Sep 06 17:06:17 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:17 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49" returned: 0 in 0.418s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:17 devstack sudo[98109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 1G
Sep 06 17:06:17 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:18 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342.a7b12468-c498-41dc-9d55-06b589eb41ef" returned: 0 in 0.258s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-a7b12468-c498-41dc-9d55-06b589eb41ef" released by "_delete_snapshot" :: held 1.515s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-44eed897-f42d-4ad5-a3a1-3266b999e342" released by "delete_snapshot" :: held 1.543s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:18 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Created reservations ['ca65893e-b579-4f8a-a3dc-119d25d54384', 'b6fb81cf-ca10-4c82-950f-d1d8cd8c5838', 'f48bfc7f-744c-42fe-b684-042aa284d563', 'cbc6c9ff-f0b2-4edc-92a4-16c698370843'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777" returned: 0 in 0.396s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:18 devstack sudo[98117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777
Sep 06 17:06:18 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Delete snapshot completed successfully.
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9a497cdd-5f4c-4271-ae01-e27e7a8aff48 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-a7b12468-c498-41dc-9d55-06b589eb41ef-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:18 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 1G" returned: 0 in 0.455s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:18 devstack sudo[98126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1
Sep 06 17:06:18 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:18 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242.ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777" returned: 0 in 0.296s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-ebf7f6ef-9e1e-4496-b6cb-0c339b2d7777" released by "_delete_snapshot" :: held 1.751s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-462ba17f-555e-43bf-9be4-6b3b5e9ec242" released by "delete_snapshot" :: held 1.778s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:18 devstack cinder-volume[87474]: WARNING cinder.quota [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1702116318 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1702116318, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['edaf7fcd-a55b-41c1-8c6b-792515f895a4', '69ca9eac-b418-44f5-9dcd-f8e7b303e52a', 'ccdabfa6-05cd-4811-aa84-97f96e21a130', 'b9f39abe-b7a8-4d78-bc39-662e16300dfe'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-76a09b2d-732b-46f9-80b8-f5435fe2bd82 tempest-GroupSnapshotsTest-1302474336 None] group_snapshot aa41cfd8-4266-443d-bcf2-901355f8e41b: deleted successfully
Sep 06 17:06:18 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1" returned: 0 in 0.329s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:18 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 is being set with open permissions: ugo+rw
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:18 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1
Sep 06 17:06:18 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:18 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1" returned: 0 in 0.285s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:19 devstack sudo[98141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.info
Sep 06 17:06:19 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-462ba17f-555e-43bf-9be4-6b3b5e9ec242" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-462ba17f-555e-43bf-9be4-6b3b5e9ec242" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (5118bcab-a5f1-4ab1-923a-16efdf40cdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c55fab-2f15-41b1-ae8c-f391ebd86879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7817917-c961-4495-bc93-4c0e9b76219d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:19 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.info" returned: 0 in 0.397s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:19 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.info is being set with open permissions: ugo+rw
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c55fab-2f15-41b1-ae8c-f391ebd86879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-609934661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4631a1-45f1-4eab-b365-ec958cf2cb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b343e8fb54281b2a056a358d82811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:19Z,use_quota=True,user_id='ddc2725ed03d4a2eb69e1e4a7a77a46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:19 devstack sudo[98145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.info
Sep 06 17:06:19 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ce35f5-dc97-4e0c-994b-9c0379373bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ce35f5-dc97-4e0c-994b-9c0379373bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f2e6ed-307f-4c92-afea-5b9d1f8400f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f2e6ed-307f-4c92-afea-5b9d1f8400f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c4631a1-45f1-4eab-b365-ec958cf2cb23', 'volume_name': 'volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c597554-0349-4d09-ab66-f56152833a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c597554-0349-4d09-ab66-f56152833a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3163a01c-fd35-4a8c-86ce-083aad6832df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:19 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Volume 5c4631a1-45f1-4eab-b365-ec958cf2cb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23', 'volume_size': 1}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:19 devstack sudo[98144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242
Sep 06 17:06:19 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:19 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.info" returned: 0 in 0.255s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-609934661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c4631a1-45f1-4eab-b365-ec958cf2cb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b343e8fb54281b2a056a358d82811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:19Z,use_quota=True,user_id='ddc2725ed03d4a2eb69e1e4a7a77a46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Creating volume 5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:19 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:19 devstack sudo[98151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 1073741824
Sep 06 17:06:19 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:19 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-15daafaa-8139-430a-9dad-74d76e82b080 tempest-VolumesSnapshotListTestJSON-95729072 None] Create snapshot completed successfully
Sep 06 17:06:19 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242" returned: 0 in 0.376s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:19 devstack sudo[98154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242
Sep 06 17:06:19 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:20 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-462ba17f-555e-43bf-9be4-6b3b5e9ec242" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-462ba17f-555e-43bf-9be4-6b3b5e9ec242" released by "delete_volume" :: held 0.749s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['23d2b310-e422-465f-9046-843faac4d645'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:20 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 1073741824" returned: 0 in 0.436s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:20 devstack cinder-volume[87474]: WARNING cinder.db.api [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1702116318']
Sep 06 17:06:20 devstack sudo[98161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['72e739fe-6468-40fa-8d03-19bf94fd71ed', '464ddbe3-8af2-4ede-9ff2-e2de64944696', 'd24c377a-151f-4faf-b954-1efa2d881024', 'adfb844f-8615-4fb9-85a2-0e97baf2d6be'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:20 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:20 devstack sudo[98163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:20 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:20 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23" returned: 0 in 0.268s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3163a01c-fd35-4a8c-86ce-083aad6832df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac78dac2-ccdf-4c02-8ee8-d58b62a5bd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Volume volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 (5c4631a1-45f1-4eab-b365-ec958cf2cb23): created successfully
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac78dac2-ccdf-4c02-8ee8-d58b62a5bd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (5118bcab-a5f1-4ab1-923a-16efdf40cdc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-038dc4f5-5cc6-4cd6-9690-9de61feeaab0 tempest-VolumesSnapshotTestJSON-467432576 None] Created volume successfully.
Sep 06 17:06:20 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.259s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d2ca3d25-06b0-4c51-abdc-f363c2bde16f tempest-GroupSnapshotsTest-1302474336 None] Delete group completed successfully.
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Creating offline snapshot e445d46e-0579-4617-b5d8-f6c4a7efe44f of volume 8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c553c78-f43e-480a-82ea-831902611f77]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-42a5bb63-7ad5-4607-88e0-4b8e438292d3 tempest-GroupSnapshotsTest-1302474336 None] Group tempest-GroupSnapshotsTest-Group-805884277: creating
Sep 06 17:06:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-42a5bb63-7ad5-4607-88e0-4b8e438292d3 tempest-GroupSnapshotsTest-1302474336 None] Group tempest-GroupSnapshotsTest-Group-805884277: created successfully
Sep 06 17:06:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-42a5bb63-7ad5-4607-88e0-4b8e438292d3 tempest-GroupSnapshotsTest-1302474336 None] Create group completed successfully.
Sep 06 17:06:20 devstack sudo[98167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1
Sep 06 17:06:20 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:21 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:21 devstack sudo[98172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f 1G
Sep 06 17:06:21 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:21 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f 1G" returned: 0 in 0.429s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:21 devstack sudo[98179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f
Sep 06 17:06:21 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:21 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:21 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f is being set with open permissions: ugo+rw
Sep 06 17:06:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:21 devstack sudo[98184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f
Sep 06 17:06:21 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:22 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f" returned: 0 in 0.269s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.436s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.708s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Creating offline snapshot 9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 of volume 5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0c85459f-194b-42af-ba9a-c49da4651e06 tempest-VolumesSnapshotListTestJSON-95729072 None] Create snapshot completed successfully
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce18b8b7-e4b6-4572-b427-6ebc01228b72]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:22 devstack sudo[98187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23
Sep 06 17:06:22 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Flow 'volume_create_manager' (ec3b18b1-72ee-4595-92bf-3fee3b2ac421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06492930-3394-40df-9bb0-7c00d0c86234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06492930-3394-40df-9bb0-7c00d0c86234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-262459010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76692408-e93e-40a6-91b0-324c1e84ff56,host='devstack@QuobyteHD#QuobyteHD',id=4fbf1254-bc69-4858-a95d-0ad7a0180ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8220ec4d831848c2b7697bfd058e02a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:22Z,use_quota=True,user_id='7db63b5f9fec4987a6a59773c9a6d18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aaa0a10a-4334-4d90-8078-c72278f8496a),volume_type_id=aaa0a10a-4334-4d90-8078-c72278f8496a)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5b46fc-374b-4059-abb2-66da3882d76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5b46fc-374b-4059-abb2-66da3882d76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6791171d-4aa4-49e7-88b0-f82d468f3f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6791171d-4aa4-49e7-88b0-f82d468f3f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fbf1254-bc69-4858-a95d-0ad7a0180ab6', 'volume_name': 'volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090357b9-d410-43cc-9e83-612ea861fd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090357b9-d410-43cc-9e83-612ea861fd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0005a797-657c-45da-9860-8b4d53d9d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:22 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Volume 4fbf1254-bc69-4858-a95d-0ad7a0180ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6', 'volume_size': 1}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:22 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23" returned: 0 in 0.373s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:22 devstack sudo[98192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 1G
Sep 06 17:06:22 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:22 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 1G" returned: 0 in 0.416s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:23 devstack sudo[98198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0
Sep 06 17:06:23 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:23 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0" returned: 0 in 0.269s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:23 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 is being set with open permissions: ugo+rw
Sep 06 17:06:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:23 devstack sudo[98203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0
Sep 06 17:06:23 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:23 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0" returned: 0 in 0.235s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:23 devstack sudo[98206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.info
Sep 06 17:06:23 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:23 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.info" returned: 0 in 0.236s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:23 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.info is being set with open permissions: ugo+rw
Sep 06 17:06:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:23 devstack sudo[98209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.info
Sep 06 17:06:23 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:24 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.info" returned: 0 in 0.234s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.520s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=76692408-e93e-40a6-91b0-324c1e84ff56,created_at=2026-09-06T15:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-262459010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76692408-e93e-40a6-91b0-324c1e84ff56,host='devstack@QuobyteHD#QuobyteHD',id=4fbf1254-bc69-4858-a95d-0ad7a0180ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8220ec4d831848c2b7697bfd058e02a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:22Z,use_quota=True,user_id='7db63b5f9fec4987a6a59773c9a6d18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aaa0a10a-4334-4d90-8078-c72278f8496a),volume_type_id=aaa0a10a-4334-4d90-8078-c72278f8496a)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Creating volume 4fbf1254-bc69-4858-a95d-0ad7a0180ab6 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:24 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:24 devstack sudo[98212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 1073741824
Sep 06 17:06:24 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c9635b89-a0ae-4917-aa3c-f42e25773d2c tempest-VolumesSnapshotTestJSON-467432576 None] Create snapshot completed successfully
Sep 06 17:06:24 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 1073741824" returned: 0 in 0.400s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:24 devstack sudo[98218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6
Sep 06 17:06:24 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:24 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" returned: 0 in 0.247s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.740s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0005a797-657c-45da-9860-8b4d53d9d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e74856-5979-4e07-a0fe-c917bb71bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Creating offline snapshot 08baadee-1ade-48d8-af88-237b620a97a8 of volume 8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:24 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Volume volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 (4fbf1254-bc69-4858-a95d-0ad7a0180ab6): created successfully
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e74856-5979-4e07-a0fe-c917bb71bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Flow 'volume_create_manager' (ec3b18b1-72ee-4595-92bf-3fee3b2ac421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c44037d-3769-4f9c-bcde-0e87b25242c7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-41a9f772-f0c0-47f5-b066-53fed1bef5e5 tempest-GroupSnapshotsTest-1302474336 None] Created volume successfully.
Sep 06 17:06:24 devstack sudo[98221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f
Sep 06 17:06:24 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (7fa2a7f8-497f-4a3b-be65-d207c3392507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b62e75-4bdc-4d98-a2c0-5afbb1a47219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b62e75-4bdc-4d98-a2c0-5afbb1a47219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1912605199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750afa43-8aad-470f-b2fb-4e177a110aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b343e8fb54281b2a056a358d82811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:25Z,use_quota=True,user_id='ddc2725ed03d4a2eb69e1e4a7a77a46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14791cd0-b04a-4b84-9b49-8ffd5bad53e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14791cd0-b04a-4b84-9b49-8ffd5bad53e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87da41e-ef63-4be7-9f7c-5a68d37ac093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87da41e-ef63-4be7-9f7c-5a68d37ac093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '750afa43-8aad-470f-b2fb-4e177a110aa6', 'volume_name': 'volume-750afa43-8aad-470f-b2fb-4e177a110aa6', 'volume_size': 2, 'snapshot_id': '9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b95f29-87b0-49c5-808e-6cc1ac03afdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:25 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56b95f29-87b0-49c5-808e-6cc1ac03afdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7beda2-d655-47cd-a810-0ddbb8c849c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:25 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Volume 750afa43-8aad-470f-b2fb-4e177a110aa6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-750afa43-8aad-470f-b2fb-4e177a110aa6', 'volume_size': 2, 'snapshot_id': '9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0'}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f" returned: 0 in 0.417s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:25 devstack sudo[98226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 1G
Sep 06 17:06:25 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:25 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 1G" returned: 0 in 0.440s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:25 devstack sudo[98231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8
Sep 06 17:06:25 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:25 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8" returned: 0 in 0.301s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:25 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 is being set with open permissions: ugo+rw
Sep 06 17:06:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:26 devstack sudo[98236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8
Sep 06 17:06:26 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:26 devstack sudo[98238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:26 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:26 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8" returned: 0 in 0.323s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.635s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.095s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0-750afa43-8aad-470f-b2fb-4e177a110aa6" by "_create_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0-750afa43-8aad-470f-b2fb-4e177a110aa6" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Creating volume 750afa43-8aad-470f-b2fb-4e177a110aa6 from snapshot 9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 {{(pid=87474) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-750afa43-8aad-470f-b2fb-4e177a110aa6" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:26 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ef0dbf43-b532-47dd-af5d-c81a70079740 tempest-VolumesSnapshotListTestJSON-95729072 None] Create snapshot completed successfully
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-750afa43-8aad-470f-b2fb-4e177a110aa6" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] snapshot: 9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0, volume: 750afa43-8aad-470f-b2fb-4e177a110aa6,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:06:26 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.351s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee623092-562c-47d2-8f6e-e4c2792a50ab]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Flow 'volume_create_manager' (6287adbd-a4f8-4576-a843-51a5597ba9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2680670-137a-4cde-8074-f5ba19ae4c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2680670-137a-4cde-8074-f5ba19ae4c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941934589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76692408-e93e-40a6-91b0-324c1e84ff56,host='devstack@QuobyteHD#QuobyteHD',id=4d4547bf-f909-4f42-8b22-456d80b4277b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8220ec4d831848c2b7697bfd058e02a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:26Z,use_quota=True,user_id='7db63b5f9fec4987a6a59773c9a6d18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aaa0a10a-4334-4d90-8078-c72278f8496a),volume_type_id=aaa0a10a-4334-4d90-8078-c72278f8496a)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdb53ca-3731-4d70-9c3c-c5820c9e872b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdb53ca-3731-4d70-9c3c-c5820c9e872b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3122210d-b94c-45ed-aec5-c4b6fc47c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3122210d-b94c-45ed-aec5-c4b6fc47c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4547bf-f909-4f42-8b22-456d80b4277b', 'volume_name': 'volume-4d4547bf-f909-4f42-8b22-456d80b4277b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e7da23-4785-41d0-ae29-13066c0ca99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8e7da23-4785-41d0-ae29-13066c0ca99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b3a4c7-88e2-4afa-92e4-f375faffc2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:26 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Volume 4d4547bf-f909-4f42-8b22-456d80b4277b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4547bf-f909-4f42-8b22-456d80b4277b', 'volume_size': 1}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:26 devstack sudo[98242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0
Sep 06 17:06:26 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:26 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df6f680-98a8-4387-9851-56f2dba0f1ec]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:26 devstack sudo[98249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23
Sep 06 17:06:26 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:27 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23" returned: 0 in 0.377s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:06:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:06:27 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6 not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:06:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:27 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6
Sep 06 17:06:27 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-08baadee-1ade-48d8-af88-237b620a97a8-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-08baadee-1ade-48d8-af88-237b620a97a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-quobyte-08baadee-1ade-48d8-af88-237b620a97a8" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-08baadee-1ade-48d8-af88-237b620a97a8" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Deleting offline snapshot 08baadee-1ade-48d8-af88-237b620a97a8 of volume 8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] snapshot_file for this snap is: volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca9706-9fda-4d94-9ae0-3871ef01c890]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:28 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8
Sep 06 17:06:28 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:29 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8" returned: 0 in 0.645s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:29 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af553cc-bedb-4c63-8757-343ab4edd857]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:29 devstack sudo[98271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f
Sep 06 17:06:29 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:30 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f" returned: 0 in 1.104s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:30 devstack sudo[98279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8
Sep 06 17:06:30 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:31 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8" returned: 0 in 0.843s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:31 devstack sudo[98286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8
Sep 06 17:06:31 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:31 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.08baadee-1ade-48d8-af88-237b620a97a8" returned: 0 in 0.462s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-08baadee-1ade-48d8-af88-237b620a97a8" released by "_delete_snapshot" :: held 3.295s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" released by "delete_snapshot" :: held 3.339s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Created reservations ['19e23367-f83f-4649-9cb1-eb9fa2f39db3', '8b3a8212-ca9e-42e2-8091-0f8ae886b039', 'e475b0a7-65ca-4102-9540-0a24c324da76', '3acf5b06-a84c-4982-b30b-2c1a95d84fbe'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:31 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Delete snapshot completed successfully.
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c19ef2f-7ab5-40e4-a053-ff7cc877ec69 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-08baadee-1ade-48d8-af88-237b620a97a8-delete_snapshot" released by "delete_snapshot" :: held 3.634s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:31 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6" returned: 0 in 4.628s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23, size 1024.00 MB, duration 4.63 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:06:31 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Converted 1024.00 MB image at 221.23 MB/s
Sep 06 17:06:31 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6 is being set with open permissions: ugo+rw
Sep 06 17:06:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:31 devstack sudo[98290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6
Sep 06 17:06:31 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:32 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6" returned: 0 in 0.248s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-750afa43-8aad-470f-b2fb-4e177a110aa6" released by "_copy_volume_from_snapshot" :: held 5.729s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0-750afa43-8aad-470f-b2fb-4e177a110aa6" released by "_create_volume_from_snapshot" :: held 5.813s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.843s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.576s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=76692408-e93e-40a6-91b0-324c1e84ff56,created_at=2026-09-06T15:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-941934589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=76692408-e93e-40a6-91b0-324c1e84ff56,host='devstack@QuobyteHD#QuobyteHD',id=4d4547bf-f909-4f42-8b22-456d80b4277b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8220ec4d831848c2b7697bfd058e02a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:26Z,use_quota=True,user_id='7db63b5f9fec4987a6a59773c9a6d18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aaa0a10a-4334-4d90-8078-c72278f8496a),volume_type_id=aaa0a10a-4334-4d90-8078-c72278f8496a)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Creating volume 4d4547bf-f909-4f42-8b22-456d80b4277b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:32 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:32 devstack sudo[98293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b 1073741824
Sep 06 17:06:32 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7beda2-d655-47cd-a810-0ddbb8c849c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750afa43-8aad-470f-b2fb-4e177a110aa6', 'volume_size': 2, 'snapshot_id': '9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a207c7-6b3f-46ca-8c50-90e33ef7ea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Volume volume-750afa43-8aad-470f-b2fb-4e177a110aa6 (750afa43-8aad-470f-b2fb-4e177a110aa6): created successfully
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a207c7-6b3f-46ca-8c50-90e33ef7ea1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (7fa2a7f8-497f-4a3b-be65-d207c3392507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:32 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c449bd24-e410-4a67-970c-53e7d1cfa75b tempest-VolumesSnapshotTestJSON-467432576 None] Created volume successfully.
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-e445d46e-0579-4617-b5d8-f6c4a7efe44f-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-e445d46e-0579-4617-b5d8-f6c4a7efe44f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-quobyte-e445d46e-0579-4617-b5d8-f6c4a7efe44f" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-e445d46e-0579-4617-b5d8-f6c4a7efe44f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Deleting offline snapshot e445d46e-0579-4617-b5d8-f6c4a7efe44f of volume 8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] snapshot_file for this snap is: volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e74846e-98a6-4207-81c2-6a055c64496a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:32 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b 1073741824" returned: 0 in 0.444s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:32 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b
Sep 06 17:06:32 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:32 devstack sudo[98298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f
Sep 06 17:06:32 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-750afa43-8aad-470f-b2fb-4e177a110aa6-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:32 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b" returned: 0 in 0.278s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b3a4c7-88e2-4afa-92e4-f375faffc2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4547bf-f909-4f42-8b22-456d80b4277b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3356a7-a564-4d37-a8b0-ad582f653733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-750afa43-8aad-470f-b2fb-4e177a110aa6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:33 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Volume volume-4d4547bf-f909-4f42-8b22-456d80b4277b (4d4547bf-f909-4f42-8b22-456d80b4277b): created successfully
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3356a7-a564-4d37-a8b0-ad582f653733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:33 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Flow 'volume_create_manager' (6287adbd-a4f8-4576-a843-51a5597ba9b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f" returned: 0 in 0.402s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cf24af35-ba21-46e4-932f-998218dbf9a7 tempest-GroupSnapshotsTest-1302474336 None] Created volume successfully.
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d19f0bc-5a2d-44ab-8e46-a2ac3a92b4ae]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-750afa43-8aad-470f-b2fb-4e177a110aa6" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-750afa43-8aad-470f-b2fb-4e177a110aa6" acquired by "delete_volume" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f316d6ca-7a7d-4f65-a499-49c01be4b119]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:33 devstack sudo[98306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1
Sep 06 17:06:33 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:33 devstack sudo[98307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6
Sep 06 17:06:33 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:33 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:33 devstack sudo[98314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f
Sep 06 17:06:33 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:33 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6" returned: 0 in 0.363s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:33 devstack sudo[98318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6
Sep 06 17:06:33 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:33 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-750afa43-8aad-470f-b2fb-4e177a110aa6" returned: 0 in 0.234s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-750afa43-8aad-470f-b2fb-4e177a110aa6" released by "delete_volume" :: held 0.633s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:33 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Created reservations ['b4580d3e-8036-4aec-9f6e-7d5bbab3cc4b', 'bcaabbce-955f-45a5-82b5-7aac91c957d8', 'ffe26303-d926-4ce0-b6f5-814c46c524ba', 'c1a51b6e-837a-45d1-b4bd-ec37148f2d4e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f" returned: 0 in 0.368s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:33 devstack sudo[98324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f
Sep 06 17:06:33 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:33 devstack sudo[98326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:33 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:34 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.e445d46e-0579-4617-b5d8-f6c4a7efe44f" returned: 0 in 0.247s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-e445d46e-0579-4617-b5d8-f6c4a7efe44f" released by "_delete_snapshot" :: held 1.475s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" released by "delete_snapshot" :: held 1.503s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:34 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.272s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Deleted volume successfully.
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7cca0e06-6af1-4732-93d8-566d8748c506 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-750afa43-8aad-470f-b2fb-4e177a110aa6-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Created reservations ['21cccfed-7bd7-4c97-a5de-9773aa1cea2d', '50f4a37f-bd69-422a-a1de-5bac15a08caa', 'fcc8913a-5ffb-47f1-a5f8-82a38c18d3d5', '6276d775-9181-4bac-879e-ad3985112f66'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-5c4631a1-45f1-4eab-b365-ec958cf2cb23" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-5c4631a1-45f1-4eab-b365-ec958cf2cb23" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Delete snapshot completed successfully.
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Deleting offline snapshot 9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 of volume 5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] snapshot_file for this snap is: volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f33ff13-389c-481d-b0fd-138568879f44 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-e445d46e-0579-4617-b5d8-f6c4a7efe44f-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9629fc3-1bcd-4696-bba5-d43ba59115fc]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:34 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0
Sep 06 17:06:34 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-331fd483-01d1-45d9-9362-a13e76f74d78 tempest-GroupSnapshotsTest-1302474336 None] Update group completed successfully.
Sep 06 17:06:34 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0" returned: 0 in 0.348s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ed941f-310a-4071-b3a0-368387eb74ad]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-cbe8aad1-a58a-4430-a733-c641f7a34ab1-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-cbe8aad1-a58a-4430-a733-c641f7a34ab1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-quobyte-cbe8aad1-a58a-4430-a733-c641f7a34ab1" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-cbe8aad1-a58a-4430-a733-c641f7a34ab1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Deleting offline snapshot cbe8aad1-a58a-4430-a733-c641f7a34ab1 of volume 8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] snapshot_file for this snap is: volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:34 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23
Sep 06 17:06:34 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9757b5d1-2b00-4885-a7f3-d8e9a2ad674c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:34 devstack sudo[98337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1
Sep 06 17:06:34 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:35 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1" returned: 0 in 0.364s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb26702-4e97-4353-97c0-45b03894c7dc]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:35 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23" returned: 0 in 0.556s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:35 devstack sudo[98349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0
Sep 06 17:06:35 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:35 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49
Sep 06 17:06:35 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:35 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:35 devstack sudo[98359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1
Sep 06 17:06:35 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e403a7ad-3973-4b06-ba7c-c9f4a46d569b tempest-GroupSnapshotsTest-1302474336 None] Update group completed successfully.
Sep 06 17:06:35 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0" returned: 0 in 0.413s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:35 devstack sudo[98361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0
Sep 06 17:06:35 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:35 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23.9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0" returned: 0 in 0.247s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:35 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1" returned: 0 in 0.371s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0" released by "_delete_snapshot" :: held 1.668s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-5c4631a1-45f1-4eab-b365-ec958cf2cb23" released by "delete_snapshot" :: held 1.694s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:35 devstack sudo[98367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1
Sep 06 17:06:35 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Created reservations ['3eba44be-44b8-4306-81cb-2761f9d27d96', 'ce8984b6-1a05-4ee5-82fe-ca189b2f91c2', '3c84e963-0a0c-468a-b782-11bcfb94106e', 'a66fbeb1-858e-40ba-a537-3209d796a324'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Delete snapshot completed successfully.
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4eb9fef4-6b1d-435d-b726-53aebb2f65a1 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-9c6ba9af-06f5-4f1b-8bb1-78b793b0fcd0-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:36 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49.cbe8aad1-a58a-4430-a733-c641f7a34ab1" returned: 0 in 0.250s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-cbe8aad1-a58a-4430-a733-c641f7a34ab1" released by "_delete_snapshot" :: held 1.464s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" released by "delete_snapshot" :: held 1.486s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Created reservations ['d5aac79d-93f0-4ba1-9000-9ef701be4bea', 'cb8c8f4e-36e3-48ca-9aa9-b0262e8f96b7', '9df7bf56-7f04-4233-997a-e733a3056f52', '69401a0a-c699-4ca3-af74-c86a8cdbb3e1'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Delete snapshot completed successfully.
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-07f6feef-feab-44fd-8d9c-836087808fc0 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-cbe8aad1-a58a-4430-a733-c641f7a34ab1-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-5c4631a1-45f1-4eab-b365-ec958cf2cb23-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-5c4631a1-45f1-4eab-b365-ec958cf2cb23-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-5c4631a1-45f1-4eab-b365-ec958cf2cb23" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-5c4631a1-45f1-4eab-b365-ec958cf2cb23" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[408464c4-fcfb-4fd9-a535-4a19d71eb1ba]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:36 devstack sudo[98370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23
Sep 06 17:06:36 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-800c7165-ffa3-40f8-acba-091c7f1ac311 tempest-GroupSnapshotsTest-1302474336 None] Update group completed successfully.
Sep 06 17:06:36 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23" returned: 0 in 0.372s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-8d37c66e-6bf5-4def-9679-6a91cdd25c49-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:36 devstack sudo[98375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23
Sep 06 17:06:36 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-8d37c66e-6bf5-4def-9679-6a91cdd25c49-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" acquired by "delete_volume" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9dfbab-8b32-48b3-a346-d0258f807316]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:37 devstack sudo[98377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49
Sep 06 17:06:37 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:37 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5c4631a1-45f1-4eab-b365-ec958cf2cb23" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-5c4631a1-45f1-4eab-b365-ec958cf2cb23" released by "delete_volume" :: held 0.692s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Created reservations ['1cb297d4-c166-4df7-9e0c-0fe9fa950efb', 'dd560685-d71f-4bc4-82c1-c9ae70d7c6dd', '5031f7f7-0aa8-47f9-a84a-91d2c63816a5', '7e5e250f-1910-4cf0-bc5a-25a05acb90dc'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:37 devstack sudo[98380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:37 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:37 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49" returned: 0 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:37 devstack sudo[98385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49
Sep 06 17:06:37 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:37 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Deleted volume successfully.
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-73a23309-d74f-4d29-9774-b6a3d6e91ac2 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-5c4631a1-45f1-4eab-b365-ec958cf2cb23-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:37 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8d37c66e-6bf5-4def-9679-6a91cdd25c49" returned: 0 in 0.249s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-quobyte-8d37c66e-6bf5-4def-9679-6a91cdd25c49" released by "delete_volume" :: held 0.654s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Created reservations ['d7aeff52-6551-4fd8-9e95-15a7a242772a', '562143db-8f90-45d5-8854-c75eee9f0d15', 'c182f1cc-0636-4bc5-ab6b-1441398b4d6b', '888e3200-60bd-45ba-b688-da1463424380'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:37 devstack sudo[98389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:37 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-dd471fd7-6e44-4eb4-bc43-d6e5de018099 tempest-GroupSnapshotsTest-1302474336 None] Update group completed successfully.
Sep 06 17:06:38 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.277s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Deleted volume successfully.
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d5e67c2e-67ce-4dc4-bff1-e16ee55c57f4 tempest-VolumesSnapshotListTestJSON-95729072 None] Lock "cinder-8d37c66e-6bf5-4def-9679-6a91cdd25c49-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (4370f350-7d1e-4f06-bda6-eb7f2842f7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46232b20-ac94-4b9d-8dba-86a539570890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46232b20-ac94-4b9d-8dba-86a539570890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272863522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5622bd-d352-4f56-a426-fd3c5d818681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b343e8fb54281b2a056a358d82811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:38Z,use_quota=True,user_id='ddc2725ed03d4a2eb69e1e4a7a77a46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e62691-63d5-400e-9e91-80d0aa58f541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e62691-63d5-400e-9e91-80d0aa58f541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a095c060-c140-4a18-a8fb-88e46dafbae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a095c060-c140-4a18-a8fb-88e46dafbae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5622bd-d352-4f56-a426-fd3c5d818681', 'volume_name': 'volume-4b5622bd-d352-4f56-a426-fd3c5d818681', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e2b0fc-afdc-42fe-b0c2-9902f0bc8621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e2b0fc-afdc-42fe-b0c2-9902f0bc8621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5258bd5-a3ef-42fe-8f02-2fa9a7509b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:38 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Volume 4b5622bd-d352-4f56-a426-fd3c5d818681: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5622bd-d352-4f56-a426-fd3c5d818681', 'volume_size': 1}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-272863522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b5622bd-d352-4f56-a426-fd3c5d818681,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b343e8fb54281b2a056a358d82811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:38Z,use_quota=True,user_id='ddc2725ed03d4a2eb69e1e4a7a77a46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Creating volume 4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:38 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:38 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 1073741824
Sep 06 17:06:38 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:38 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 1073741824" returned: 0 in 0.418s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:38 devstack sudo[98398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681
Sep 06 17:06:38 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:38 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681" returned: 0 in 0.251s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5258bd5-a3ef-42fe-8f02-2fa9a7509b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5622bd-d352-4f56-a426-fd3c5d818681', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91978746-a2d7-4e93-8a51-d0afcc7c4bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:39 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Volume volume-4b5622bd-d352-4f56-a426-fd3c5d818681 (4b5622bd-d352-4f56-a426-fd3c5d818681): created successfully
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91978746-a2d7-4e93-8a51-d0afcc7c4bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (4370f350-7d1e-4f06-bda6-eb7f2842f7a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:39 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ea23c9e9-1d0f-40d8-8a8b-32c50b06247c tempest-VolumesSnapshotTestJSON-467432576 None] Created volume successfully.
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Creating offline snapshot 882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 of volume 4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[de193365-a810-4c14-bdf1-0f82e1720ab1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:39 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681
Sep 06 17:06:39 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:39 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] GroupSnapshot ba0a81c5-3ad0-4949-8d52-59ffad0dd5c8: creating.
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Group snapshot ba0a81c5-3ad0-4949-8d52-59ffad0dd5c8: creating. {{(pid=87474) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:39 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681" returned: 0 in 0.410s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:39 devstack sudo[98406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 1G
Sep 06 17:06:39 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:40 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 1G" returned: 0 in 0.437s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b5622bd-d352-4f56-a426-fd3c5d818681 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:40 devstack sudo[98412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b5622bd-d352-4f56-a426-fd3c5d818681 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2
Sep 06 17:06:40 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:40 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b5622bd-d352-4f56-a426-fd3c5d818681 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2" returned: 0 in 0.278s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:40 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 is being set with open permissions: ugo+rw
Sep 06 17:06:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:40 devstack sudo[98418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2
Sep 06 17:06:40 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:40 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:40 devstack sudo[98421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.info
Sep 06 17:06:40 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:41 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.info" returned: 0 in 0.240s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:41 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.info is being set with open permissions: ugo+rw
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:41 devstack sudo[98424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.info
Sep 06 17:06:41 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:41 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.info" returned: 0 in 0.243s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.681s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Creating offline snapshot 788740f3-0769-4d06-a6e4-19736941916a of volume 4fbf1254-bc69-4858-a95d-0ad7a0180ab6 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8be0786f-1008-4acd-996c-2245b9412fde tempest-VolumesSnapshotTestJSON-467432576 None] Create snapshot completed successfully
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad85fdf-71e4-499a-92a2-d7ae47427f1e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:41 devstack sudo[98427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6
Sep 06 17:06:41 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:41 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" returned: 0 in 0.358s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:41 devstack sudo[98433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a 1G
Sep 06 17:06:41 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (c4e45287-970b-40fc-822d-b155134655b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:42 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a445507-2342-4f00-908b-e9cdb14dbb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a 1G" returned: 0 in 0.494s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a445507-2342-4f00-908b-e9cdb14dbb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-351486106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b3dad3-6277-4c25-abc0-4f4ce32ae47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1b343e8fb54281b2a056a358d82811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=882a9bdc-73d7-4e20-ace3-bbba3fa15dc2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:42Z,use_quota=True,user_id='ddc2725ed03d4a2eb69e1e4a7a77a46b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:42 devstack sudo[98440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a
Sep 06 17:06:42 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7c5cd3-eca5-4929-9f10-381f6e9ed3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7c5cd3-eca5-4929-9f10-381f6e9ed3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5174ce-3761-4c6e-a49c-725f1cfb181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad5174ce-3761-4c6e-a49c-725f1cfb181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f3b3dad3-6277-4c25-abc0-4f4ce32ae47e', 'volume_name': 'volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e', 'volume_size': 1, 'snapshot_id': '882a9bdc-73d7-4e20-ace3-bbba3fa15dc2'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b30131c-9109-41e4-ac4a-208e3c67c128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b30131c-9109-41e4-ac4a-208e3c67c128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32dd577a-5958-40bb-a8b0-62e38360ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Volume f3b3dad3-6277-4c25-abc0-4f4ce32ae47e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e', 'volume_size': 1, 'snapshot_id': '882a9bdc-73d7-4e20-ace3-bbba3fa15dc2'}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Flow 'volume_create_manager' (306df5ed-b2e7-4acc-9610-bb1ab1e4a0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e16e759-4344-4ed2-9023-06c1f2b3c461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e16e759-4344-4ed2-9023-06c1f2b3c461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1825656553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0435078-46d7-46f2-b2b5-379d630b48f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4d75871da54e66a205c0f6d55266f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:42Z,use_quota=True,user_id='db3f671749e24217a3e98452194fe6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e1bc72-fe89-483e-b7d4-94b49185418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e1bc72-fe89-483e-b7d4-94b49185418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864aa903-73ba-4568-8ead-0fb0c1faa426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864aa903-73ba-4568-8ead-0fb0c1faa426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0435078-46d7-46f2-b2b5-379d630b48f6', 'volume_name': 'volume-a0435078-46d7-46f2-b2b5-379d630b48f6', 'volume_size': 2}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e538bcb2-53d5-42ed-a439-717b2c213648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e538bcb2-53d5-42ed-a439-717b2c213648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3793f548-c988-4126-9a61-b907f416ab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:42 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Volume a0435078-46d7-46f2-b2b5-379d630b48f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0435078-46d7-46f2-b2b5-379d630b48f6', 'volume_size': 2}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:42 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:42 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:42 devstack sudo[98445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a
Sep 06 17:06:42 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:42 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a" returned: 0 in 0.234s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:42 devstack sudo[98448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.info
Sep 06 17:06:42 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:43 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.info" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:43 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:43 devstack sudo[98452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.info
Sep 06 17:06:43 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:43 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.info" returned: 0 in 0.233s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Creating offline snapshot df3839f8-d409-4c05-a33b-84bd8038084c of volume 4d4547bf-f909-4f42-8b22-456d80b4277b {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5e2083-8612-4a96-9c18-537dfa2700e6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:43 devstack sudo[98455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b
Sep 06 17:06:43 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:43 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b" returned: 0 in 0.334s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:43 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c 1G
Sep 06 17:06:43 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:43 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c 1G" returned: 0 in 0.368s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4547bf-f909-4f42-8b22-456d80b4277b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:44 devstack sudo[98465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4547bf-f909-4f42-8b22-456d80b4277b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c
Sep 06 17:06:44 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:44 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4547bf-f909-4f42-8b22-456d80b4277b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c" returned: 0 in 0.283s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:44 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:06:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:44 devstack sudo[98470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c
Sep 06 17:06:44 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:44 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c" returned: 0 in 0.229s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:44 devstack sudo[98473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.info
Sep 06 17:06:44 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:44 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.info" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:44 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:06:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:44 devstack sudo[98476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.info
Sep 06 17:06:44 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:44 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.info" returned: 0 in 0.232s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.754s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.620s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1825656553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0435078-46d7-46f2-b2b5-379d630b48f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d4d75871da54e66a205c0f6d55266f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:42Z,use_quota=True,user_id='db3f671749e24217a3e98452194fe6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Creating volume a0435078-46d7-46f2-b2b5-379d630b48f6 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:45 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6 2147483648 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:45 devstack sudo[98479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6 2147483648
Sep 06 17:06:45 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-baf1e25f-89a6-4632-bd6e-b7cf2a0fd066 tempest-GroupSnapshotsTest-1302474336 None] group_snapshot ba0a81c5-3ad0-4949-8d52-59ffad0dd5c8: created successfully
Sep 06 17:06:45 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6 2147483648" returned: 0 in 0.468s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:45 devstack sudo[98484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6
Sep 06 17:06:45 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:45 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6" returned: 0 in 0.233s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.478s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-882a9bdc-73d7-4e20-ace3-bbba3fa15dc2-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" by "_create_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3793f548-c988-4126-9a61-b907f416ab83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0435078-46d7-46f2-b2b5-379d630b48f6', 'volume_size': 2}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7913c16-7fa4-491c-870f-106776e81f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-882a9bdc-73d7-4e20-ace3-bbba3fa15dc2-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Creating volume f3b3dad3-6277-4c25-abc0-4f4ce32ae47e from snapshot 882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 {{(pid=87474) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:45 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Volume volume-a0435078-46d7-46f2-b2b5-379d630b48f6 (a0435078-46d7-46f2-b2b5-379d630b48f6): created successfully
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7913c16-7fa4-491c-870f-106776e81f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Flow 'volume_create_manager' (306df5ed-b2e7-4acc-9610-bb1ab1e4a0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] snapshot: 882a9bdc-73d7-4e20-ace3-bbba3fa15dc2, volume: f3b3dad3-6277-4c25-abc0-4f4ce32ae47e,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:06:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-05316efb-5088-445b-a6b0-aa60eea55697 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Created volume successfully.
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c414881-7166-41e3-9b50-2446cba18f8a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:45 devstack sudo[98487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2
Sep 06 17:06:45 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:46 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] group_snapshot ba0a81c5-3ad0-4949-8d52-59ffad0dd5c8: deleting
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] group_snapshot ba0a81c5-3ad0-4949-8d52-59ffad0dd5c8: deleting {{(pid=87474) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-788740f3-0769-4d06-a6e4-19736941916a" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:46 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2" returned: 0 in 0.402s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b5622bd-d352-4f56-a426-fd3c5d818681(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-788740f3-0769-4d06-a6e4-19736941916a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Deleting offline snapshot 788740f3-0769-4d06-a6e4-19736941916a of volume 4fbf1254-bc69-4858-a95d-0ad7a0180ab6 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] snapshot_file for this snap is: volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ec6002-36d1-4558-b5ea-44d2b5195610]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cc8c80-2757-43f0-88fe-f61ab043d968]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:46 devstack sudo[98492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681
Sep 06 17:06:46 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:46 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a
Sep 06 17:06:46 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:46 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681" returned: 0 in 0.415s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:46 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a" returned: 0 in 0.416s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:46 devstack sudo[98502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e
Sep 06 17:06:46 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[be338722-2200-4b14-84c7-99f46669f69a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:46 devstack sudo[98504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6
Sep 06 17:06:46 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:47 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" returned: 0 in 0.355s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:47 devstack sudo[98513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a
Sep 06 17:06:47 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:47 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a" returned: 0 in 0.464s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:47 devstack sudo[98526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a
Sep 06 17:06:47 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:48 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6.788740f3-0769-4d06-a6e4-19736941916a" returned: 0 in 0.508s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-788740f3-0769-4d06-a6e4-19736941916a" released by "_delete_snapshot" :: held 1.870s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" released by "delete_snapshot" :: held 1.913s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-4d4547bf-f909-4f42-8b22-456d80b4277b" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-4d4547bf-f909-4f42-8b22-456d80b4277b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-df3839f8-d409-4c05-a33b-84bd8038084c" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-df3839f8-d409-4c05-a33b-84bd8038084c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Deleting offline snapshot df3839f8-d409-4c05-a33b-84bd8038084c of volume 4d4547bf-f909-4f42-8b22-456d80b4277b {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] snapshot_file for this snap is: volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a755b0e2-ed39-4a63-97df-341ffb52d50f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:48 devstack sudo[98529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c
Sep 06 17:06:48 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:49 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c" returned: 0 in 0.694s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4547bf-f909-4f42-8b22-456d80b4277b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:49 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bf14f5-3592-4f61-b294-c383a1f81d1b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:49 devstack sudo[98534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b
Sep 06 17:06:49 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:49 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b" returned: 0 in 0.752s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:49 devstack sudo[98539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c
Sep 06 17:06:49 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:50 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c" returned: 0 in 0.569s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:50 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c
Sep 06 17:06:50 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:50 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b.df3839f8-d409-4c05-a33b-84bd8038084c" returned: 0 in 0.437s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-df3839f8-d409-4c05-a33b-84bd8038084c" released by "_delete_snapshot" :: held 2.654s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-4d4547bf-f909-4f42-8b22-456d80b4277b" released by "delete_snapshot" :: held 2.691s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:51 devstack cinder-volume[87474]: WARNING cinder.quota [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1510670021 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1510670021, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:06:51 devstack cinder-volume[87474]: WARNING cinder.quota [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1510670021 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1510670021, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['274bf313-175c-4c90-8056-5f3349643403', '321afb16-20cf-45a8-91e5-8f18b96bf9c2', 'b4ed55eb-51e1-481b-b1c7-1c7e27bb76be', '22499b84-c6c9-4fce-9364-421ea770c1cd'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['c24dfc1a-c38c-4773-bee9-19eb725e8bfb', '00847610-e77a-41d1-8ce7-195f0e93023e', '57371ebe-944e-481f-bc9c-0a487368ddb3', 'e3e64565-ebc0-4c82-9a5a-ddc399fe7a38'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:51 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" returned: 0 in 4.535s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:06:51 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Converted 1024.00 MB image at 225.72 MB/s
Sep 06 17:06:51 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e is being set with open permissions: ugo+rw
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:51 devstack sudo[98548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e
Sep 06 17:06:51 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:51 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8479d190-e625-4f32-b19d-a7fee7021cbf tempest-GroupSnapshotsTest-1302474336 None] group_snapshot ba0a81c5-3ad0-4949-8d52-59ffad0dd5c8: deleted successfully
Sep 06 17:06:51 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" returned: 0 in 0.245s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" released by "_copy_volume_from_snapshot" :: held 5.709s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-882a9bdc-73d7-4e20-ace3-bbba3fa15dc2-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" released by "_create_volume_from_snapshot" :: held 5.783s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.814s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.927s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Creating offline snapshot f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 of volume a0435078-46d7-46f2-b2b5-379d630b48f6 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32dd577a-5958-40bb-a8b0-62e38360ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e', 'volume_size': 1, 'snapshot_id': '882a9bdc-73d7-4e20-ace3-bbba3fa15dc2'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72a91c3-b73a-43b6-a761-ea187b70172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c489134f-43a8-4d4e-b244-6ead0f113219]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:51 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Volume volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e (f3b3dad3-6277-4c25-abc0-4f4ce32ae47e): created successfully
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72a91c3-b73a-43b6-a761-ea187b70172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Flow 'volume_create_manager' (c4e45287-970b-40fc-822d-b155134655b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:51 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-42ecb279-8102-4d8a-84c4-75fc36e94d63 tempest-VolumesSnapshotTestJSON-467432576 None] Created volume successfully.
Sep 06 17:06:51 devstack sudo[98552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6
Sep 06 17:06:51 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[685302d8-c334-4302-bd98-e22dc7e266a9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:52 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6" returned: 0 in 0.418s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 2G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:52 devstack sudo[98559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 2G
Sep 06 17:06:52 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:52 devstack sudo[98557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e
Sep 06 17:06:52 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-4d4547bf-f909-4f42-8b22-456d80b4277b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-4d4547bf-f909-4f42-8b22-456d80b4277b" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e1b74f-f0e5-4980-819b-36106a460c3f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:52 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" returned: 0 in 0.400s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:52 devstack sudo[98569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e
Sep 06 17:06:52 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:52 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:52 devstack sudo[98568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 2G" returned: 0 in 0.459s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:52 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0435078-46d7-46f2-b2b5-379d630b48f6 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:52 devstack sudo[98572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0435078-46d7-46f2-b2b5-379d630b48f6 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15
Sep 06 17:06:52 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:52 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" returned: 0 in 0.250s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e" released by "delete_volume" :: held 0.698s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Created reservations ['e3800df2-3a48-41f7-b33c-ecb01763a204', '9313ba0f-cc1e-4fc7-8cda-be78016c6f2e', '96222bf0-d8e3-4027-ae87-03366883d5d8', '93920fc8-d513-4902-a5d3-b65c677c7187'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:52 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b" returned: 0 in 0.406s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:52 devstack sudo[98580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b
Sep 06 17:06:52 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:52 devstack sudo[98583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:52 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:52 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0435078-46d7-46f2-b2b5-379d630b48f6 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15" returned: 0 in 0.341s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:52 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 is being set with open permissions: ugo+rw
Sep 06 17:06:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:52 devstack sudo[98585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15
Sep 06 17:06:52 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:53 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d4547bf-f909-4f42-8b22-456d80b4277b" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:53 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-4d4547bf-f909-4f42-8b22-456d80b4277b" released by "delete_volume" :: held 0.752s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.286s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:53 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Deleted volume successfully.
Sep 06 17:06:53 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15" returned: 0 in 0.263s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" acquired by "delete_volume" :: waited 0.044s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-71aac784-5f29-42d8-abad-ac23c15c2723 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-f3b3dad3-6277-4c25-abc0-4f4ce32ae47e-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-882a9bdc-73d7-4e20-ace3-bbba3fa15dc2-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2ef28f-95ff-471f-aa77-3fd35da3d58c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-882a9bdc-73d7-4e20-ace3-bbba3fa15dc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-4b5622bd-d352-4f56-a426-fd3c5d818681" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-4b5622bd-d352-4f56-a426-fd3c5d818681" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-882a9bdc-73d7-4e20-ace3-bbba3fa15dc2" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-882a9bdc-73d7-4e20-ace3-bbba3fa15dc2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:53 devstack sudo[98591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.info
Sep 06 17:06:53 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Deleting offline snapshot 882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 of volume 4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:53 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6
Sep 06 17:06:53 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] snapshot_file for this snap is: volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1824d241-3417-484e-b78e-72eead58135b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:53 devstack sudo[98594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2
Sep 06 17:06:53 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:53 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.info" returned: 0 in 0.275s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:53 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.info is being set with open permissions: ugo+rw
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:53 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" returned: 0 in 0.379s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:53 devstack sudo[98601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.info
Sep 06 17:06:53 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:53 devstack sudo[98603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6
Sep 06 17:06:53 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:53 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2" returned: 0 in 0.391s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b5622bd-d352-4f56-a426-fd3c5d818681(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4511f969-7e9c-4254-bbb6-e015c42260ce]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:53 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.info" returned: 0 in 0.274s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:53 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-4fbf1254-bc69-4858-a95d-0ad7a0180ab6" released by "delete_volume" :: held 0.729s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:53 devstack sudo[98608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681
Sep 06 17:06:53 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:53 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4f6bfef5-f6a7-4082-941d-dadf2c239d91 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Create snapshot completed successfully
Sep 06 17:06:53 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['5f4fd8f3-7741-42e4-9cd0-906e109806ef'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:53 devstack cinder-volume[87474]: WARNING cinder.quota [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1510670021 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1510670021, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['d56f6610-c230-434e-9a30-4786a58ca9cc', '3aa6113d-9a3b-4d52-a5fe-8713282d871b', 'c0202e55-5526-414c-aaa3-9e6f2112cee7', '7954f097-70c2-442a-88e7-ae962b998a33'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Acquiring lock "cinder-f04b3665-4ab4-4bb7-9f1a-68c01ab95b15-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-f04b3665-4ab4-4bb7-9f1a-68c01ab95b15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Acquiring lock "cinder-quobyte-a0435078-46d7-46f2-b2b5-379d630b48f6" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['48fb97d6-087a-40da-af5c-f18369bd6537', 'b7b6dcb4-4171-441f-b482-9fd00fbbca14', 'e0961cfd-3c02-4e8f-9221-0df9ffe2acac', '05571e13-2803-492a-84ee-694cdfe55b04'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-quobyte-a0435078-46d7-46f2-b2b5-379d630b48f6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Acquiring lock "cinder-quobyte-f04b3665-4ab4-4bb7-9f1a-68c01ab95b15" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-quobyte-f04b3665-4ab4-4bb7-9f1a-68c01ab95b15" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Deleting offline snapshot f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 of volume a0435078-46d7-46f2-b2b5-379d630b48f6 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] snapshot_file for this snap is: volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2610f6-03c0-4266-9612-3a717a11d7f4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:54 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681" returned: 0 in 0.632s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:54 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:54 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:54 devstack sudo[98614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15
Sep 06 17:06:54 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:54 devstack sudo[98617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2
Sep 06 17:06:54 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:54 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.262s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ba9b4222-0cce-43ed-8423-647df4f9208d tempest-GroupSnapshotsTest-1302474336 None] Delete group completed successfully.
Sep 06 17:06:54 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15" returned: 0 in 0.381s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0435078-46d7-46f2-b2b5-379d630b48f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[072f2929-1e43-4b92-8eb7-5e19a33219cb]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:54 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2" returned: 0 in 0.367s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:54 devstack sudo[98630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2
Sep 06 17:06:54 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:54 devstack sudo[98629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6
Sep 06 17:06:54 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:54 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681.882a9bdc-73d7-4e20-ace3-bbba3fa15dc2" returned: 0 in 0.263s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-882a9bdc-73d7-4e20-ace3-bbba3fa15dc2" released by "_delete_snapshot" :: held 1.779s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-4b5622bd-d352-4f56-a426-fd3c5d818681" released by "delete_snapshot" :: held 1.826s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:55 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6" returned: 0 in 0.416s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:55 devstack sudo[98637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15
Sep 06 17:06:55 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f311e47e-41ee-418a-8009-6353d73717e7 tempest-GroupSnapshotsTest-1302474336 None] Group tempest-GroupSnapshotsTest-Group-518230292: creating
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Created reservations ['9cf3ec5e-d8db-4938-9805-e5033322421d', 'ad05d356-0481-4127-bf3d-6f12855ca53e', '4dcf1c61-f76e-4b2d-a5ec-3a0e7027e228', 'f8a9258f-98ab-4a62-a2b8-a131e9855af2'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f311e47e-41ee-418a-8009-6353d73717e7 tempest-GroupSnapshotsTest-1302474336 None] Group tempest-GroupSnapshotsTest-Group-518230292: created successfully
Sep 06 17:06:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f311e47e-41ee-418a-8009-6353d73717e7 tempest-GroupSnapshotsTest-1302474336 None] Create group completed successfully.
Sep 06 17:06:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Delete snapshot completed successfully.
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b4dfc8a-0aa9-46c5-bacb-777cc8b400ab tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-882a9bdc-73d7-4e20-ace3-bbba3fa15dc2-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-4b5622bd-d352-4f56-a426-fd3c5d818681-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-4b5622bd-d352-4f56-a426-fd3c5d818681-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-4b5622bd-d352-4f56-a426-fd3c5d818681" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-4b5622bd-d352-4f56-a426-fd3c5d818681" acquired by "delete_volume" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[356192d6-c414-4663-bff0-a790c5580a06]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:55 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15" returned: 0 in 0.411s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:55 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15
Sep 06 17:06:55 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:55 devstack sudo[98643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681
Sep 06 17:06:55 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:55 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6.f04b3665-4ab4-4bb7-9f1a-68c01ab95b15" returned: 0 in 0.288s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-quobyte-f04b3665-4ab4-4bb7-9f1a-68c01ab95b15" released by "_delete_snapshot" :: held 1.617s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:55 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681" returned: 0 in 0.367s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-quobyte-a0435078-46d7-46f2-b2b5-379d630b48f6" released by "delete_snapshot" :: held 1.664s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:55 devstack sudo[98651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681
Sep 06 17:06:55 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:55 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Created reservations ['037b7660-5668-4731-a482-8cbfc0401463', '8eadd594-28a2-4c88-a32e-5b47c95f08a1', '9c4c13ae-0216-441c-a176-86bd9f181298', 'a065b8aa-5896-47cd-baa0-7312a5a0f87f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Delete snapshot completed successfully.
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c84997b-8dd6-4ac5-afa6-0f766211ad95 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-f04b3665-4ab4-4bb7-9f1a-68c01ab95b15-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:56 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4b5622bd-d352-4f56-a426-fd3c5d818681" returned: 0 in 0.246s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-4b5622bd-d352-4f56-a426-fd3c5d818681" released by "delete_volume" :: held 0.676s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Created reservations ['b7cc53dc-d3bb-49cf-8fe0-0df1fde979a0', '5e878215-8551-49d1-b6f1-bb66df4ea817', '93a26b93-967b-40df-8633-5230e7192c68', '4ff365ef-01c1-471b-b1d3-9d0dd609966f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:56 devstack sudo[98654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:56 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Acquiring lock "cinder-a0435078-46d7-46f2-b2b5-379d630b48f6-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-a0435078-46d7-46f2-b2b5-379d630b48f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Acquiring lock "cinder-quobyte-a0435078-46d7-46f2-b2b5-379d630b48f6" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-quobyte-a0435078-46d7-46f2-b2b5-379d630b48f6" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:56 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Deleted volume successfully.
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb60526c-2c06-4d26-aa14-3620eb662c5a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-988b0244-e8cc-4e58-a645-5593a7a18291 tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-4b5622bd-d352-4f56-a426-fd3c5d818681-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-44eed897-f42d-4ad5-a3a1-3266b999e342-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-44eed897-f42d-4ad5-a3a1-3266b999e342-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "cinder-quobyte-44eed897-f42d-4ad5-a3a1-3266b999e342" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-44eed897-f42d-4ad5-a3a1-3266b999e342" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:06:56 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6
Sep 06 17:06:56 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d55261-f9ba-45e3-90da-3de8a9bce341]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:06:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Flow 'volume_create_manager' (88211024-ad79-459b-8426-178803fcd357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17025114-f8a5-4c05-97c8-1f575c315915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17025114-f8a5-4c05-97c8-1f575c315915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1956223316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=db64b4f0-f1c5-4d67-a5fe-d2de35868bb9,host='devstack@QuobyteHD#QuobyteHD',id=82352136-111b-4f8e-878a-0824d422c0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8220ec4d831848c2b7697bfd058e02a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:57Z,use_quota=True,user_id='7db63b5f9fec4987a6a59773c9a6d18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f36b3710-bdeb-4e31-9827-49f9414c2847),volume_type_id=f36b3710-bdeb-4e31-9827-49f9414c2847)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:57 devstack sudo[98659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342
Sep 06 17:06:57 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcdaec7-46af-498e-813d-a12e3b8b077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcdaec7-46af-498e-813d-a12e3b8b077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dace4b0-0e94-4991-89a9-7b24af3ae816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dace4b0-0e94-4991-89a9-7b24af3ae816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82352136-111b-4f8e-878a-0824d422c0eb', 'volume_name': 'volume-82352136-111b-4f8e-878a-0824d422c0eb', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d99813-b75c-4681-bb14-44f06b55e16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d99813-b75c-4681-bb14-44f06b55e16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57068bf-3e59-4def-87c7-2dd53cd4b122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:57 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Volume 82352136-111b-4f8e-878a-0824d422c0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82352136-111b-4f8e-878a-0824d422c0eb', 'volume_size': 1}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=db64b4f0-f1c5-4d67-a5fe-d2de35868bb9,created_at=2026-09-06T15:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1956223316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=db64b4f0-f1c5-4d67-a5fe-d2de35868bb9,host='devstack@QuobyteHD#QuobyteHD',id=82352136-111b-4f8e-878a-0824d422c0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8220ec4d831848c2b7697bfd058e02a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:06:57Z,use_quota=True,user_id='7db63b5f9fec4987a6a59773c9a6d18c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f36b3710-bdeb-4e31-9827-49f9414c2847),volume_type_id=f36b3710-bdeb-4e31-9827-49f9414c2847)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Creating volume 82352136-111b-4f8e-878a-0824d422c0eb {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:06:57 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:57 devstack sudo[98664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb 1073741824
Sep 06 17:06:57 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:57 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6" returned: 0 in 0.452s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:57 devstack sudo[98666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6
Sep 06 17:06:57 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:57 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342" returned: 0 in 0.421s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:57 devstack sudo[98673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342
Sep 06 17:06:57 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:57 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0435078-46d7-46f2-b2b5-379d630b48f6" returned: 0 in 0.289s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-quobyte-a0435078-46d7-46f2-b2b5-379d630b48f6" released by "delete_volume" :: held 0.847s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Created reservations ['3868e195-cac7-4b49-ab33-9f486f277d3d', 'cc72167b-94e4-40be-a13f-bfb5546fa178', '56d0e79c-f9af-439a-a53a-996522b15952', '9fc95470-4207-429e-8b6f-57b8c0b939f2'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:57 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb 1073741824" returned: 0 in 0.458s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:57 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-44eed897-f42d-4ad5-a3a1-3266b999e342" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-quobyte-44eed897-f42d-4ad5-a3a1-3266b999e342" released by "delete_volume" :: held 0.772s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:57 devstack sudo[98679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:57 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:57 devstack sudo[98681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb
Sep 06 17:06:57 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Created reservations ['c56eca75-71fc-4b47-89f7-6d0501b20669', '4d78c7b0-9003-4d8f-8977-ed79ecc8685d', 'c8eb2f61-ec59-42ec-9506-5ec31898df0e', '079e49a6-e02b-4430-b6d3-ad36527e9a5a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:57 devstack sudo[98683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:06:57 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:57 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.336s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:57 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:57 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Deleted volume successfully.
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb" returned: 0 in 0.314s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57068bf-3e59-4def-87c7-2dd53cd4b122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82352136-111b-4f8e-878a-0824d422c0eb', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8945e5ac-42cc-4feb-a124-b34cfb0ddff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a746de50-9f55-492f-8106-ad10f2e4d673 tempest-VolumesSnapshotNegativeTestJSON-1415117893 None] Lock "cinder-a0435078-46d7-46f2-b2b5-379d630b48f6-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:57 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Volume volume-82352136-111b-4f8e-878a-0824d422c0eb (82352136-111b-4f8e-878a-0824d422c0eb): created successfully
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8945e5ac-42cc-4feb-a124-b34cfb0ddff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:06:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Flow 'volume_create_manager' (88211024-ad79-459b-8426-178803fcd357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:06:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-968b6aa4-15c8-428a-9e60-d7d43f5deeba tempest-GroupSnapshotsTest-1302474336 None] Created volume successfully.
Sep 06 17:06:58 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:06:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Deleted volume successfully.
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aef76ea4-d555-41ea-9da8-664c1d52101a tempest-VolumesSnapshotTestJSON-467432576 None] Lock "cinder-44eed897-f42d-4ad5-a3a1-3266b999e342-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:06:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] GroupSnapshot 3f423ad0-80ce-4f8d-8857-ebfd96dc1e44: creating.
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Group snapshot 3f423ad0-80ce-4f8d-8857-ebfd96dc1e44: creating. {{(pid=87474) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Creating offline snapshot 05b6b9f3-a31b-40d0-9e48-fbbde79d4301 of volume 82352136-111b-4f8e-878a-0824d422c0eb {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3540d7-1bd7-4be4-a526-68370f2dc4b9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:58 devstack sudo[98688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb
Sep 06 17:06:58 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:58 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb" returned: 0 in 0.458s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:58 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 1G
Sep 06 17:06:58 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:59 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 1G" returned: 0 in 0.555s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82352136-111b-4f8e-878a-0824d422c0eb -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:59 devstack sudo[98736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82352136-111b-4f8e-878a-0824d422c0eb -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301
Sep 06 17:06:59 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:06:59 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root
Sep 06 17:06:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82352136-111b-4f8e-878a-0824d422c0eb -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301" returned: 0 in 0.361s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:06:59 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:06:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:06:59 devstack sudo[98742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301
Sep 06 17:06:59 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:00 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:00 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=214,cinder:UPDATE=220,cinder:DELETE=8,cinder:INSERT=64 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:07:00 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=212,cinder:UPDATE=218,cinder:INSERT=47,cinder:DELETE=18 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:07:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:00 devstack sudo[98745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.info
Sep 06 17:07:00 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:00 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.info" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:00 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 06 17:07:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:00 devstack sudo[98748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.info
Sep 06 17:07:00 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:00 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.info" returned: 0 in 0.267s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.311s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7da3cb18-f36a-4868-b6f0-4d572ddf0462 tempest-GroupSnapshotsTest-1302474336 None] group_snapshot 3f423ad0-80ce-4f8d-8857-ebfd96dc1e44: created successfully
Sep 06 17:07:01 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] group_snapshot 3f423ad0-80ce-4f8d-8857-ebfd96dc1e44: deleting
Sep 06 17:07:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] group_snapshot 3f423ad0-80ce-4f8d-8857-ebfd96dc1e44: deleting {{(pid=87474) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-82352136-111b-4f8e-878a-0824d422c0eb" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-82352136-111b-4f8e-878a-0824d422c0eb" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-05b6b9f3-a31b-40d0-9e48-fbbde79d4301" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-05b6b9f3-a31b-40d0-9e48-fbbde79d4301" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Deleting offline snapshot 05b6b9f3-a31b-40d0-9e48-fbbde79d4301 of volume 82352136-111b-4f8e-878a-0824d422c0eb {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] snapshot_file for this snap is: volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab23983-3a17-4f08-b092-bb24b6c263ca]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:02 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301
Sep 06 17:07:02 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:02 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301" returned: 0 in 0.440s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82352136-111b-4f8e-878a-0824d422c0eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96b0219-c061-45b2-ade9-dcf80005df83]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:07:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:02 devstack sudo[98758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb
Sep 06 17:07:02 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:03 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb" returned: 0 in 0.412s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:03 devstack sudo[98764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301
Sep 06 17:07:03 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:03 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301" returned: 0 in 0.482s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:03 devstack sudo[98770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301
Sep 06 17:07:03 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:03 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb.05b6b9f3-a31b-40d0-9e48-fbbde79d4301" returned: 0 in 0.279s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-05b6b9f3-a31b-40d0-9e48-fbbde79d4301" released by "_delete_snapshot" :: held 1.750s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:07:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-82352136-111b-4f8e-878a-0824d422c0eb" released by "delete_snapshot" :: held 1.791s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:07:03 devstack cinder-volume[87474]: WARNING cinder.quota [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1449125264 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1449125264, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:07:03 devstack cinder-volume[87474]: WARNING cinder.quota [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1449125264 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1449125264, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:07:03 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['1742fbe4-069a-4ba8-bb87-f7e3fe7f18fc', '7e74024a-1128-4627-a22f-aca059147436', '6078c109-f653-4ba0-a49d-1201992b456b', '42759ce4-b03a-4ada-a409-663b2b763281'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:04 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5b59cdf1-d720-401b-8daa-fdcef8253bab tempest-GroupSnapshotsTest-1302474336 None] group_snapshot 3f423ad0-80ce-4f8d-8857-ebfd96dc1e44: deleted successfully
Sep 06 17:07:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "cinder-quobyte-82352136-111b-4f8e-878a-0824d422c0eb" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:07:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-82352136-111b-4f8e-878a-0824d422c0eb" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:07:04 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6093df-70c2-415d-b380-159e2d198617]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:07:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:04 devstack sudo[98773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb
Sep 06 17:07:04 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:05 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb" returned: 0 in 0.430s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:05 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb
Sep 06 17:07:05 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:05 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-82352136-111b-4f8e-878a-0824d422c0eb" returned: 0 in 0.285s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Lock "cinder-quobyte-82352136-111b-4f8e-878a-0824d422c0eb" released by "delete_volume" :: held 0.794s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['cf4cd273-7fe7-4015-a1ba-d7549656af7d'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:05 devstack cinder-volume[87474]: WARNING cinder.quota [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1449125264 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1449125264, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Created reservations ['3071d945-25bf-4b74-a8d3-ca9a05e6e7f7', 'f66d2e90-614f-4ff8-be9d-69deb7b97691', 'f2d88e3b-f878-43b0-ab11-2d374d63b6a5', '392d188f-4b0b-4e59-a9c0-8ffa5e5ad56e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:05 devstack sudo[98781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:07:05 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:06 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.420s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:06 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:07:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-aa66474f-d9a1-4a01-8523-5296a9c3852b tempest-GroupSnapshotsTest-1302474336 None] Delete group completed successfully.
Sep 06 17:07:15 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=21,cinder:UPDATE=16,cinder:INSERT=6 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:07:15 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=16,cinder:INSERT=4,cinder:UPDATE=21 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:07:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-288be02f-ac66-4c8b-9ec5-84f6902bb00e tempest-GroupsTest-1632931638 None] Group tempest-Group1-261522570: creating
Sep 06 17:07:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-288be02f-ac66-4c8b-9ec5-84f6902bb00e tempest-GroupsTest-1632931638 None] Group tempest-Group1-261522570: created successfully
Sep 06 17:07:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-288be02f-ac66-4c8b-9ec5-84f6902bb00e tempest-GroupsTest-1632931638 None] Create group completed successfully.
Sep 06 17:07:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-30d785ea-3adb-40ee-b64a-aa0b3d89fe8c tempest-GroupsTest-1632931638 None] Group tempest-Group2-25209368: creating
Sep 06 17:07:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-30d785ea-3adb-40ee-b64a-aa0b3d89fe8c tempest-GroupsTest-1632931638 None] Group tempest-Group2-25209368: created successfully
Sep 06 17:07:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-30d785ea-3adb-40ee-b64a-aa0b3d89fe8c tempest-GroupsTest-1632931638 None] Create group completed successfully.
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Flow 'volume_create_manager' (c9599e4a-5352-4eeb-9925-8daa7742b3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d840e1-a952-416d-9a43-a6f34fd19d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d840e1-a952-416d-9a43-a6f34fd19d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2113318385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d63380d2-3c51-43cb-a553-8507ee48f1a1,host='devstack@QuobyteHD#QuobyteHD',id=51103d1b-e95f-40ce-82f9-f0c2b1cb2237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea879c18def472c8404a2b44e9aae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:20Z,use_quota=True,user_id='5961368bac7747b694be3eb8568b9163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63d9a474-212c-42ba-8f1a-989bd5419e31),volume_type_id=63d9a474-212c-42ba-8f1a-989bd5419e31)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f0f247-463a-4813-9ceb-eb569e32994b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0f0f247-463a-4813-9ceb-eb569e32994b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef218a6d-a411-4ed2-83bf-61ef14a7c15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef218a6d-a411-4ed2-83bf-61ef14a7c15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51103d1b-e95f-40ce-82f9-f0c2b1cb2237', 'volume_name': 'volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a14fc8-f0f3-4d89-836c-b27816f02c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a14fc8-f0f3-4d89-836c-b27816f02c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4321fe0e-eeda-486c-970a-4da67f7873a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:19 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Volume 51103d1b-e95f-40ce-82f9-f0c2b1cb2237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237', 'volume_size': 1}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d63380d2-3c51-43cb-a553-8507ee48f1a1,created_at=2026-09-06T15:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2113318385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d63380d2-3c51-43cb-a553-8507ee48f1a1,host='devstack@QuobyteHD#QuobyteHD',id=51103d1b-e95f-40ce-82f9-f0c2b1cb2237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea879c18def472c8404a2b44e9aae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:20Z,use_quota=True,user_id='5961368bac7747b694be3eb8568b9163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63d9a474-212c-42ba-8f1a-989bd5419e31),volume_type_id=63d9a474-212c-42ba-8f1a-989bd5419e31)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Creating volume 51103d1b-e95f-40ce-82f9-f0c2b1cb2237 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:07:19 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:07:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:19 devstack sudo[98791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237 1073741824
Sep 06 17:07:19 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:20 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237 1073741824" returned: 0 in 0.536s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:20 devstack sudo[98797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237
Sep 06 17:07:20 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:20 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:07:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4321fe0e-eeda-486c-970a-4da67f7873a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65478087-b31e-4862-ac98-598e0dd904c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Volume volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237 (51103d1b-e95f-40ce-82f9-f0c2b1cb2237): created successfully
Sep 06 17:07:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65478087-b31e-4862-ac98-598e0dd904c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Flow 'volume_create_manager' (c9599e4a-5352-4eeb-9925-8daa7742b3f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3b4ed6a9-aaa2-4f79-8984-60798876fd36 tempest-GroupsTest-1632931638 None] Created volume successfully.
Sep 06 17:07:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Acquiring lock "cinder-quobyte-51103d1b-e95f-40ce-82f9-f0c2b1cb2237" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:07:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Lock "cinder-quobyte-51103d1b-e95f-40ce-82f9-f0c2b1cb2237" acquired by "delete_volume" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:07:21 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2e1d16-71d4-4ef2-8432-d870924542e0]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:07:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:21 devstack sudo[98801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237
Sep 06 17:07:21 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:22 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237" returned: 0 in 0.425s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:22 devstack sudo[98806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237
Sep 06 17:07:22 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:22 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-51103d1b-e95f-40ce-82f9-f0c2b1cb2237" returned: 0 in 0.272s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Lock "cinder-quobyte-51103d1b-e95f-40ce-82f9-f0c2b1cb2237" released by "delete_volume" :: held 0.749s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Created reservations ['536730e5-1876-4225-81f6-aee487609871'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:22 devstack cinder-volume[87474]: WARNING cinder.quota [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-521255682 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-521255682, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:07:22 devstack cinder-volume[87474]: WARNING cinder.quota [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-521255682 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-521255682, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Created reservations ['cad703fe-eebe-464a-a947-2413c2921bc4', 'acdabecf-159d-44fa-a01a-10654a4dae06', '530af7b1-afc9-4f56-8b8a-63edb084c54d', '5f814ee5-d95d-49f2-a800-df3eb53306ec'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:22 devstack sudo[98809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:07:22 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:23 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.372s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:07:23 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6e8846b6-1391-47a9-81a2-00451a142bc1 tempest-GroupsTest-1632931638 None] Delete group completed successfully.
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] Created reservations ['9a28474a-e9c5-497d-80c0-c27b11d270c0'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:23 devstack sudo[98812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:07:23 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:23 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.318s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:23 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:07:23 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b8a26d4e-4391-4c4e-8120-52f45842dc2a tempest-GroupsTest-1632931638 None] Delete group completed successfully.
Sep 06 17:07:25 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c152e188-6235-44d5-9b0e-28719491e1e0 tempest-GroupsTest-1632931638 None] Group tempest-GroupsTest-Group-887450916: creating
Sep 06 17:07:25 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c152e188-6235-44d5-9b0e-28719491e1e0 tempest-GroupsTest-1632931638 None] Group tempest-GroupsTest-Group-887450916: created successfully
Sep 06 17:07:25 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c152e188-6235-44d5-9b0e-28719491e1e0 tempest-GroupsTest-1632931638 None] Create group completed successfully.
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:26 devstack sudo[98816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:07:26 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:26 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.398s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:07:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Flow 'volume_create_manager' (313f30f8-367c-47c4-9e2d-086443877117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5c2ef9-d01a-47ed-b022-1749eec86148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5c2ef9-d01a-47ed-b022-1749eec86148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1573676188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f03c7981-2d1a-47e2-9cb7-39ec4d24f822,host='devstack@QuobyteHD#QuobyteHD',id=005440a2-c951-4f35-add0-65e6370c6380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea879c18def472c8404a2b44e9aae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:27Z,use_quota=True,user_id='5961368bac7747b694be3eb8568b9163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69750cce-70f9-4969-848d-17bef1ca6998),volume_type_id=69750cce-70f9-4969-848d-17bef1ca6998)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70613e4-945b-4e00-a4c4-12c16f21d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70613e4-945b-4e00-a4c4-12c16f21d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8872ffb4-91b5-4418-8225-f89dd58f0423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8872ffb4-91b5-4418-8225-f89dd58f0423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005440a2-c951-4f35-add0-65e6370c6380', 'volume_name': 'volume-005440a2-c951-4f35-add0-65e6370c6380', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076cf665-78c2-4e43-9808-f65eb805978b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076cf665-78c2-4e43-9808-f65eb805978b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712bd562-8709-4dd2-a5ae-b2999032ce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:27 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Volume 005440a2-c951-4f35-add0-65e6370c6380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005440a2-c951-4f35-add0-65e6370c6380', 'volume_size': 1}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f03c7981-2d1a-47e2-9cb7-39ec4d24f822,created_at=2026-09-06T15:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1573676188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f03c7981-2d1a-47e2-9cb7-39ec4d24f822,host='devstack@QuobyteHD#QuobyteHD',id=005440a2-c951-4f35-add0-65e6370c6380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea879c18def472c8404a2b44e9aae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:27Z,use_quota=True,user_id='5961368bac7747b694be3eb8568b9163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69750cce-70f9-4969-848d-17bef1ca6998),volume_type_id=69750cce-70f9-4969-848d-17bef1ca6998)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Creating volume 005440a2-c951-4f35-add0-65e6370c6380 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:07:27 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:27 devstack sudo[98821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380 1073741824
Sep 06 17:07:27 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:27 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380 1073741824" returned: 0 in 0.578s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:27 devstack sudo[98827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380
Sep 06 17:07:27 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:28 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380" returned: 0 in 0.317s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:07:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (712bd562-8709-4dd2-a5ae-b2999032ce3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005440a2-c951-4f35-add0-65e6370c6380', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16a0486-d95d-4544-8aaf-89f1fedee9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:28 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Volume volume-005440a2-c951-4f35-add0-65e6370c6380 (005440a2-c951-4f35-add0-65e6370c6380): created successfully
Sep 06 17:07:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16a0486-d95d-4544-8aaf-89f1fedee9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Flow 'volume_create_manager' (313f30f8-367c-47c4-9e2d-086443877117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:28 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f7a8f9c5-ed10-439c-a909-c2d872593dac tempest-GroupsTest-1632931638 None] Created volume successfully.
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Flow 'volume_create_manager' (637bef27-e735-48fd-b42c-856b2e920060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dcc5a1-4626-4bee-847d-61e68cf3efb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dcc5a1-4626-4bee-847d-61e68cf3efb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1761434265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f03c7981-2d1a-47e2-9cb7-39ec4d24f822,host='devstack@QuobyteHD#QuobyteHD',id=f17fdbcd-f791-4a9e-92e3-6d236dd43b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea879c18def472c8404a2b44e9aae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:30Z,use_quota=True,user_id='5961368bac7747b694be3eb8568b9163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69750cce-70f9-4969-848d-17bef1ca6998),volume_type_id=69750cce-70f9-4969-848d-17bef1ca6998)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06be7c63-ef3e-4cf3-b02f-f3968879ea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06be7c63-ef3e-4cf3-b02f-f3968879ea88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d41e071-00b5-44ce-8b86-f3744db13d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d41e071-00b5-44ce-8b86-f3744db13d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f17fdbcd-f791-4a9e-92e3-6d236dd43b78', 'volume_name': 'volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3f679e-d566-470c-9483-071302b366db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3f679e-d566-470c-9483-071302b366db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cc91d1-663d-48fa-a771-a2ab89cb4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:30 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Volume f17fdbcd-f791-4a9e-92e3-6d236dd43b78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78', 'volume_size': 1}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f03c7981-2d1a-47e2-9cb7-39ec4d24f822,created_at=2026-09-06T15:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1761434265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f03c7981-2d1a-47e2-9cb7-39ec4d24f822,host='devstack@QuobyteHD#QuobyteHD',id=f17fdbcd-f791-4a9e-92e3-6d236dd43b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea879c18def472c8404a2b44e9aae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:30Z,use_quota=True,user_id='5961368bac7747b694be3eb8568b9163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69750cce-70f9-4969-848d-17bef1ca6998),volume_type_id=69750cce-70f9-4969-848d-17bef1ca6998)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Creating volume f17fdbcd-f791-4a9e-92e3-6d236dd43b78 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:07:30 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:07:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:30 devstack sudo[98834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78 1073741824
Sep 06 17:07:30 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:31 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78 1073741824" returned: 0 in 0.741s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:31 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78
Sep 06 17:07:31 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:31 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78" returned: 0 in 0.315s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:07:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cc91d1-663d-48fa-a771-a2ab89cb4369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbcf927-b749-4cf8-ae0c-eb5c65adfd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:31 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Volume volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78 (f17fdbcd-f791-4a9e-92e3-6d236dd43b78): created successfully
Sep 06 17:07:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbcf927-b749-4cf8-ae0c-eb5c65adfd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Flow 'volume_create_manager' (637bef27-e735-48fd-b42c-856b2e920060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:31 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3975d666-a448-4b57-9d1f-77c6ce7dcb6c tempest-GroupsTest-1632931638 None] Created volume successfully.
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Flow 'volume_create_manager' (8982a346-d076-4481-a4f3-fba1aee432a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7491e385-1054-4a9e-9dc8-e8b3492d3feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7491e385-1054-4a9e-9dc8-e8b3492d3feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-983709932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026badea-e955-4894-90c7-6f3a9df89f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d4a564010478ba3e08f7cb89a83ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:32Z,use_quota=True,user_id='f924dcee6c7e4fe582b7e7f4053e4211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba6fc81-e0a2-403a-9738-8681308d62ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba6fc81-e0a2-403a-9738-8681308d62ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efd557c-901e-4f2c-ae16-17d20470876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efd557c-901e-4f2c-ae16-17d20470876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '026badea-e955-4894-90c7-6f3a9df89f8f', 'volume_name': 'volume-026badea-e955-4894-90c7-6f3a9df89f8f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a22970-3735-44ef-83d5-3fd8f8102a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a22970-3735-44ef-83d5-3fd8f8102a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a4dce6-d5a8-455c-9963-c7b163a616c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Volume 026badea-e955-4894-90c7-6f3a9df89f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-026badea-e955-4894-90c7-6f3a9df89f8f', 'volume_size': 1}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-983709932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026badea-e955-4894-90c7-6f3a9df89f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d4a564010478ba3e08f7cb89a83ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:32Z,use_quota=True,user_id='f924dcee6c7e4fe582b7e7f4053e4211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Creating volume 026badea-e955-4894-90c7-6f3a9df89f8f {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:07:32 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:32 devstack sudo[98867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f 1073741824
Sep 06 17:07:32 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Flow 'volume_create_manager' (a0db65f9-2611-4385-b280-70c07ce1b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bc3217-cd77-47a3-b943-cefab3a9e7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bc3217-cd77-47a3-b943-cefab3a9e7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1452484324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696ae107-0b92-4922-8342-7cd006f35662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d4a564010478ba3e08f7cb89a83ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:33Z,use_quota=True,user_id='f924dcee6c7e4fe582b7e7f4053e4211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07d9ae8-5c85-4bac-a65b-031c9ff81bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07d9ae8-5c85-4bac-a65b-031c9ff81bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b17dc43-d1f3-4ab2-a9a1-28511bbb73fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b17dc43-d1f3-4ab2-a9a1-28511bbb73fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '696ae107-0b92-4922-8342-7cd006f35662', 'volume_name': 'volume-696ae107-0b92-4922-8342-7cd006f35662', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cee35c-e79f-400d-9f42-83f8401e1990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cee35c-e79f-400d-9f42-83f8401e1990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab441e04-fb54-412f-b517-94cffdbabce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Volume 696ae107-0b92-4922-8342-7cd006f35662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-696ae107-0b92-4922-8342-7cd006f35662', 'volume_size': 1}
Sep 06 17:07:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:33 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f 1073741824" returned: 0 in 0.795s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-46b3f406-2748-4f76-b42c-83e8eca36cfc tempest-GroupsTest-1632931638 None] Update group completed successfully.
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:33 devstack sudo[98887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f
Sep 06 17:07:33 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:33 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f" returned: 0 in 0.275s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1452484324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696ae107-0b92-4922-8342-7cd006f35662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927d4a564010478ba3e08f7cb89a83ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:33Z,use_quota=True,user_id='f924dcee6c7e4fe582b7e7f4053e4211',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Creating volume 696ae107-0b92-4922-8342-7cd006f35662 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:07:33 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:33 devstack sudo[98890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662 1073741824
Sep 06 17:07:33 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a4dce6-d5a8-455c-9963-c7b163a616c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026badea-e955-4894-90c7-6f3a9df89f8f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097b26f8-a904-421e-a078-fb0ee5e90b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:33 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Volume volume-026badea-e955-4894-90c7-6f3a9df89f8f (026badea-e955-4894-90c7-6f3a9df89f8f): created successfully
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097b26f8-a904-421e-a078-fb0ee5e90b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Flow 'volume_create_manager' (8982a346-d076-4481-a4f3-fba1aee432a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-63a619cc-43b4-4ab2-a27f-2b7ddff64f3b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Created volume successfully.
Sep 06 17:07:34 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662 1073741824" returned: 0 in 0.572s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:34 devstack sudo[98896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662
Sep 06 17:07:34 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:34 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662" returned: 0 in 0.318s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:07:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab441e04-fb54-412f-b517-94cffdbabce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-696ae107-0b92-4922-8342-7cd006f35662', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371866ff-e087-4b7a-852e-baf1d414a732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Volume volume-696ae107-0b92-4922-8342-7cd006f35662 (696ae107-0b92-4922-8342-7cd006f35662): created successfully
Sep 06 17:07:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371866ff-e087-4b7a-852e-baf1d414a732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Flow 'volume_create_manager' (a0db65f9-2611-4385-b280-70c07ce1b948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e1b5ca7a-dfa1-4f54-8668-cc13542f6f1b tempest-TestServerVolumeAttachmentScenario-1852044241 None] Created volume successfully.
Sep 06 17:07:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-fd46423d-f317-46e4-9703-10e3afbb55a1 tempest-GroupsTest-1632931638 None] Update group completed successfully.
Sep 06 17:07:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Acquiring lock "cinder-quobyte-005440a2-c951-4f35-add0-65e6370c6380" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:07:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Lock "cinder-quobyte-005440a2-c951-4f35-add0-65e6370c6380" acquired by "delete_volume" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:07:36 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7fdd13-5cfa-4ca1-87b3-2c1520d797d1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:07:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:36 devstack sudo[98966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380
Sep 06 17:07:36 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:37 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380" returned: 0 in 0.427s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:37 devstack sudo[98975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380
Sep 06 17:07:37 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:37 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-005440a2-c951-4f35-add0-65e6370c6380" returned: 0 in 0.297s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Lock "cinder-quobyte-005440a2-c951-4f35-add0-65e6370c6380" released by "delete_volume" :: held 0.805s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:07:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Acquiring lock "cinder-quobyte-f17fdbcd-f791-4a9e-92e3-6d236dd43b78" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:07:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Lock "cinder-quobyte-f17fdbcd-f791-4a9e-92e3-6d236dd43b78" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:07:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[496764d3-54d7-4d88-b286-006505f9f346]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:07:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:37 devstack sudo[98978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78
Sep 06 17:07:37 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:38 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78" returned: 0 in 0.546s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:38 devstack sudo[98983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78
Sep 06 17:07:38 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:38 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f17fdbcd-f791-4a9e-92e3-6d236dd43b78" returned: 0 in 0.419s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Lock "cinder-quobyte-f17fdbcd-f791-4a9e-92e3-6d236dd43b78" released by "delete_volume" :: held 1.034s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:07:38 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Created reservations ['fe4e98f7-3c84-42af-bb49-93afb97d0a0d'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:38 devstack cinder-volume[87474]: WARNING cinder.quota [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1656667110 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1656667110, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:07:38 devstack cinder-volume[87474]: WARNING cinder.quota [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1656667110 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1656667110, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:07:38 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Created reservations ['44ecafff-d832-46f4-b648-587c878017e1', '18a16485-b771-43f2-a7cd-b13aaef503aa', 'cc6f3a2a-d92a-4bc0-9677-4a01ccb434bd', '076a90f0-126c-42fd-a3de-c5b59c6ce93f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:38 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Created reservations ['14f8c108-ad23-4a4b-87a5-206f48bfbc1c', '47ffca44-ebc7-48b5-88cf-cd1db83aa251', '79e7f9a2-4e87-4e50-85c6-19fceb04b2c2', 'aebc7bf2-7039-4837-85d3-51e24f14e54f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:39 devstack sudo[98987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:07:39 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:39 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.400s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:39 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:07:39 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1aaef4dc-f411-4a3b-8b29-cd58746c1413 tempest-GroupsTest-1632931638 None] Delete group completed successfully.
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Flow 'volume_create_manager' (546689db-2d72-41df-a44b-ff78d82deaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507dd6e5-4a0e-4edd-81da-1444404bf99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507dd6e5-4a0e-4edd-81da-1444404bf99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1768121043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544b595b-c3de-44fd-b1f9-43b24604704d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4c2521e77a48d6b5322b2679115cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:41Z,use_quota=True,user_id='7b7c095997fa47fba1e635efd25e3a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001993b4-00ed-4ce6-b013-81ea6a839c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001993b4-00ed-4ce6-b013-81ea6a839c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870e30b6-498c-4e1d-85d6-12c7a0c3d7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870e30b6-498c-4e1d-85d6-12c7a0c3d7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544b595b-c3de-44fd-b1f9-43b24604704d', 'volume_name': 'volume-544b595b-c3de-44fd-b1f9-43b24604704d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457f4ce7-e420-4645-a2da-7f4e6a9fdca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457f4ce7-e420-4645-a2da-7f4e6a9fdca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b6186f-ac69-4899-b3f1-ea1bb27a35df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:40 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Volume 544b595b-c3de-44fd-b1f9-43b24604704d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544b595b-c3de-44fd-b1f9-43b24604704d', 'volume_size': 1}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1768121043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544b595b-c3de-44fd-b1f9-43b24604704d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4c2521e77a48d6b5322b2679115cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:07:41Z,use_quota=True,user_id='7b7c095997fa47fba1e635efd25e3a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Creating volume 544b595b-c3de-44fd-b1f9-43b24604704d {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:07:40 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:07:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:40 devstack sudo[99006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d 1073741824
Sep 06 17:07:40 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:41 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d 1073741824" returned: 0 in 0.740s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:41 devstack sudo[99013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d
Sep 06 17:07:41 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:41 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d" returned: 0 in 0.327s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:07:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b6186f-ac69-4899-b3f1-ea1bb27a35df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544b595b-c3de-44fd-b1f9-43b24604704d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18841554-e660-4ce8-9e8c-7a28443db7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:07:41 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Volume volume-544b595b-c3de-44fd-b1f9-43b24604704d (544b595b-c3de-44fd-b1f9-43b24604704d): created successfully
Sep 06 17:07:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18841554-e660-4ce8-9e8c-7a28443db7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:07:42 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Flow 'volume_create_manager' (546689db-2d72-41df-a44b-ff78d82deaa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:07:42 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-93cb676d-da98-4bba-bf9e-784bc6563a82 tempest-TestMinimumBasicScenario-976761781 None] Created volume successfully.
Sep 06 17:07:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-271f1211-4eac-481b-8739-f584ab632be0 req-2f6ac556-8085-4105-bec8-60e15856947c tempest-TestMinimumBasicScenario-976761781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-271f1211-4eac-481b-8739-f584ab632be0 req-2f6ac556-8085-4105-bec8-60e15856947c tempest-TestMinimumBasicScenario-976761781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-271f1211-4eac-481b-8739-f584ab632be0 req-2f6ac556-8085-4105-bec8-60e15856947c tempest-TestMinimumBasicScenario-976761781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-271f1211-4eac-481b-8739-f584ab632be0 req-2f6ac556-8085-4105-bec8-60e15856947c tempest-TestMinimumBasicScenario-976761781 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-544b595b-c3de-44fd-b1f9-43b24604704d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7f7fd0b4-0f8d-44ee-9401-94ecbd67fce1', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:07:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-271f1211-4eac-481b-8739-f584ab632be0 req-2f6ac556-8085-4105-bec8-60e15856947c tempest-TestMinimumBasicScenario-976761781 None] attachment_update completed successfully.
Sep 06 17:07:50 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-08a093bf-5753-43db-abd9-d9a0f8682c7b tempest-GroupsV320Test-1874217053 None] Group tempest-GroupsV320Test-Group-2049638362: creating
Sep 06 17:07:50 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-08a093bf-5753-43db-abd9-d9a0f8682c7b tempest-GroupsV320Test-1874217053 None] Group tempest-GroupsV320Test-Group-2049638362: created successfully
Sep 06 17:07:50 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-08a093bf-5753-43db-abd9-d9a0f8682c7b tempest-GroupsV320Test-1874217053 None] Create group completed successfully.
Sep 06 17:07:52 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] Created reservations ['5f6283aa-62d3-44f2-a833-1dbe7f1c9402'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:07:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:07:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:07:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:07:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:07:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:07:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:07:52 devstack sudo[99519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:07:52 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:07:52 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root
Sep 06 17:07:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.300s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:07:52 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:07:52 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9afbf948-fe48-4a2a-adc4-0e4f4300430a tempest-GroupsV320Test-1874217053 None] Delete group completed successfully.
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Flow 'volume_create_manager' (7edbc710-a314-4f21-9afb-e2293ee9e9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d9bcae-348d-4c64-94c0-89edcc78f608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d9bcae-348d-4c64-94c0-89edcc78f608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2020766960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a9b621-ecea-41e5-b18c-3bc6e1f253e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84fb5911d87463fb22d64915f429ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:01Z,use_quota=True,user_id='fd77a4fc4e78413b8d9227f492cfcb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64c29ba4-b476-4b83-9154-3216fb2ab9e8),volume_type_id=64c29ba4-b476-4b83-9154-3216fb2ab9e8)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd39cdf-b5c0-40f2-8630-f3e8ebd4e3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd39cdf-b5c0-40f2-8630-f3e8ebd4e3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c3cb1a-c7bc-439f-8a6c-33dba83a7c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c3cb1a-c7bc-439f-8a6c-33dba83a7c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a9b621-ecea-41e5-b18c-3bc6e1f253e0', 'volume_name': 'volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0006b7-339e-488e-9d07-a55b5b02d5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff0006b7-339e-488e-9d07-a55b5b02d5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b721ad92-c7ad-4fe7-85e3-61414c3409b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:00 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Volume 24a9b621-ecea-41e5-b18c-3bc6e1f253e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0', 'volume_size': 1}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2020766960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a9b621-ecea-41e5-b18c-3bc6e1f253e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84fb5911d87463fb22d64915f429ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:01Z,use_quota=True,user_id='fd77a4fc4e78413b8d9227f492cfcb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(64c29ba4-b476-4b83-9154-3216fb2ab9e8),volume_type_id=64c29ba4-b476-4b83-9154-3216fb2ab9e8)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Creating volume 24a9b621-ecea-41e5-b18c-3bc6e1f253e0 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:08:00 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:08:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:00 devstack sudo[99583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0 1073741824
Sep 06 17:08:00 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:01 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0 1073741824" returned: 0 in 0.428s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:01 devstack sudo[99589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0
Sep 06 17:08:01 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:01 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b721ad92-c7ad-4fe7-85e3-61414c3409b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd360d3-7682-4b4e-9165-7d33c8d42f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:01 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Volume volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0 (24a9b621-ecea-41e5-b18c-3bc6e1f253e0): created successfully
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd360d3-7682-4b4e-9165-7d33c8d42f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Flow 'volume_create_manager' (7edbc710-a314-4f21-9afb-e2293ee9e9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:01 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1fc624eb-ffca-4c01-9c80-9a35baa1f06f tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Created volume successfully.
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-317810ef-ba85-4bf7-8041-5321c01fffa2 tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-317810ef-ba85-4bf7-8041-5321c01fffa2 tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-317810ef-ba85-4bf7-8041-5321c01fffa2 tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-317810ef-ba85-4bf7-8041-5321c01fffa2 tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-317810ef-ba85-4bf7-8041-5321c01fffa2 tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-317810ef-ba85-4bf7-8041-5321c01fffa2 tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:01 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:08:01 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:02 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-317810ef-ba85-4bf7-8041-5321c01fffa2 tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:02 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-317810ef-ba85-4bf7-8041-5321c01fffa2 tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:08:02 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-317810ef-ba85-4bf7-8041-5321c01fffa2 tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Retype volume completed successfully.
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Acquiring lock "cinder-24a9b621-ecea-41e5-b18c-3bc6e1f253e0-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "cinder-24a9b621-ecea-41e5-b18c-3bc6e1f253e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Acquiring lock "cinder-quobyte-24a9b621-ecea-41e5-b18c-3bc6e1f253e0" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "cinder-quobyte-24a9b621-ecea-41e5-b18c-3bc6e1f253e0" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51e5a9d-126e-435b-9be9-808f25e503d8]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:03 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0
Sep 06 17:08:03 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:03 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0" returned: 0 in 0.367s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:03 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0
Sep 06 17:08:03 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:03 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-24a9b621-ecea-41e5-b18c-3bc6e1f253e0" returned: 0 in 0.243s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "cinder-quobyte-24a9b621-ecea-41e5-b18c-3bc6e1f253e0" released by "delete_volume" :: held 0.656s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:03 devstack cinder-volume[87474]: WARNING cinder.quota [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:08:03 devstack cinder-volume[87474]: WARNING cinder.quota [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:08:03 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Created reservations ['a429b0ee-f0d6-4f44-a760-91ff14b255ec', 'e9ea9d23-2ff4-4e0f-8071-0bf97faac75c', 'e7e93bf4-fde9-40b2-839e-0b16d9bdefcc', 'c21d9e86-1b30-4589-80e4-d2529eac191e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:08:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:04 devstack sudo[99632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:08:04 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:04 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.241s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:04 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:08:04 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Deleted volume successfully.
Sep 06 17:08:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-29072484-94e6-441d-893b-779749e9aadd tempest-VolumeRetypeWithoutMigrationTest-1199118083 None] Lock "cinder-24a9b621-ecea-41e5-b18c-3bc6e1f253e0-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-2b39f4c9-4848-4c3d-b1a7-d8d052f68519 req-8ff18e3e-a700-40a3-aaa7-17b4611bed7c tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-2b39f4c9-4848-4c3d-b1a7-d8d052f68519 req-8ff18e3e-a700-40a3-aaa7-17b4611bed7c tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-2b39f4c9-4848-4c3d-b1a7-d8d052f68519 req-8ff18e3e-a700-40a3-aaa7-17b4611bed7c tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-2b39f4c9-4848-4c3d-b1a7-d8d052f68519 req-8ff18e3e-a700-40a3-aaa7-17b4611bed7c tempest-TestServerVolumeAttachmentScenario-1852044241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-026badea-e955-4894-90c7-6f3a9df89f8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '323851ae-cedf-4ea7-b48c-711b7ad8872d', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:08:10 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-2b39f4c9-4848-4c3d-b1a7-d8d052f68519 req-8ff18e3e-a700-40a3-aaa7-17b4611bed7c tempest-TestServerVolumeAttachmentScenario-1852044241 None] attachment_update completed successfully.
Sep 06 17:08:15 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=81,cinder:UPDATE=77,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:08:15 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=83,cinder:UPDATE=77,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:08:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-062605b5-dc01-4af3-ae7a-d0d335795ab0 req-d680d81a-e170-4940-a5ad-7e619631782d tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-062605b5-dc01-4af3-ae7a-d0d335795ab0 req-d680d81a-e170-4940-a5ad-7e619631782d tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-062605b5-dc01-4af3-ae7a-d0d335795ab0 req-d680d81a-e170-4940-a5ad-7e619631782d tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-062605b5-dc01-4af3-ae7a-d0d335795ab0 req-d680d81a-e170-4940-a5ad-7e619631782d tempest-TestServerVolumeAttachmentScenario-1852044241 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-696ae107-0b92-4922-8342-7cd006f35662', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17cecbd0-b193-4a2c-b8aa-2a9bdc367c5e', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:08:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-062605b5-dc01-4af3-ae7a-d0d335795ab0 req-d680d81a-e170-4940-a5ad-7e619631782d tempest-TestServerVolumeAttachmentScenario-1852044241 None] attachment_update completed successfully.
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Flow 'volume_create_manager' (0ff0d3a1-1eec-474d-b504-2368a1e23ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0893459f-eb52-40d2-89b9-1a36545fea88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0893459f-eb52-40d2-89b9-1a36545fea88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1801167705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d656821-fbb4-43c8-8ea2-508f95fc98f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a2783f8e9949a0b38132c87aaaa560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:17Z,use_quota=True,user_id='e79339c33a6e423a852b5f1c5196e0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14406fe1-1add-4af4-9ed1-5577c9ce2cdd),volume_type_id=14406fe1-1add-4af4-9ed1-5577c9ce2cdd)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1dc744-89b2-498e-b58f-35678559018f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1dc744-89b2-498e-b58f-35678559018f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206faebb-26e6-4f90-aec4-f4c4a324c416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206faebb-26e6-4f90-aec4-f4c4a324c416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d656821-fbb4-43c8-8ea2-508f95fc98f7', 'volume_name': 'volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d9711e-2ee2-41c7-9c2d-a713671eab75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d9711e-2ee2-41c7-9c2d-a713671eab75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe34917-b9be-4ec8-be5d-0066e962bb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:17 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Volume 5d656821-fbb4-43c8-8ea2-508f95fc98f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7', 'volume_size': 1}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1801167705',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d656821-fbb4-43c8-8ea2-508f95fc98f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a2783f8e9949a0b38132c87aaaa560',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:17Z,use_quota=True,user_id='e79339c33a6e423a852b5f1c5196e0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14406fe1-1add-4af4-9ed1-5577c9ce2cdd),volume_type_id=14406fe1-1add-4af4-9ed1-5577c9ce2cdd)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Creating volume 5d656821-fbb4-43c8-8ea2-508f95fc98f7 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:08:17 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:17 devstack sudo[99706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7 1073741824
Sep 06 17:08:17 devstack sudo[99706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:17 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-1a9a129b-2243-46aa-8a86-70c6263bcb3e req-12eaab9f-ed22-453d-a0ff-195a300081b1 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Terminate volume connection completed successfully.
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-1a9a129b-2243-46aa-8a86-70c6263bcb3e req-12eaab9f-ed22-453d-a0ff-195a300081b1 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Deleting attachment 17cecbd0-b193-4a2c-b8aa-2a9bdc367c5e. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:08:17 devstack sudo[99706]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7 1073741824" returned: 0 in 0.476s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:17 devstack sudo[99714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7
Sep 06 17:08:17 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:18 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7" returned: 0 in 0.255s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:08:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe34917-b9be-4ec8-be5d-0066e962bb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ed26c0-0f6b-4882-a2b2-8f156a00c20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:18 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Volume volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7 (5d656821-fbb4-43c8-8ea2-508f95fc98f7): created successfully
Sep 06 17:08:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ed26c0-0f6b-4882-a2b2-8f156a00c20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Flow 'volume_create_manager' (0ff0d3a1-1eec-474d-b504-2368a1e23ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c300518e-dcd4-46cd-b551-530e87c49c03 tempest-VolumeTypesAccessTest-196411761 None] Created volume successfully.
Sep 06 17:08:19 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-7cb760e6-2061-4a27-b5ad-7917de99c2ae req-8249ace4-c7e5-4e0b-b9e4-d71b0fec5232 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Terminate volume connection completed successfully.
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-7cb760e6-2061-4a27-b5ad-7917de99c2ae req-8249ace4-c7e5-4e0b-b9e4-d71b0fec5232 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Deleting attachment 323851ae-cedf-4ea7-b48c-711b7ad8872d. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Acquiring lock "cinder-5d656821-fbb4-43c8-8ea2-508f95fc98f7-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Lock "cinder-5d656821-fbb4-43c8-8ea2-508f95fc98f7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Acquiring lock "cinder-quobyte-5d656821-fbb4-43c8-8ea2-508f95fc98f7" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Lock "cinder-quobyte-5d656821-fbb4-43c8-8ea2-508f95fc98f7" acquired by "delete_volume" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b280aeae-b06b-4933-8bca-9060621f9bd1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:19 devstack sudo[99725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7
Sep 06 17:08:19 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:19 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7" returned: 0 in 0.350s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:19 devstack sudo[99730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7
Sep 06 17:08:19 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:19 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5d656821-fbb4-43c8-8ea2-508f95fc98f7" returned: 0 in 0.241s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Lock "cinder-quobyte-5d656821-fbb4-43c8-8ea2-508f95fc98f7" released by "delete_volume" :: held 0.626s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:20 devstack cinder-volume[87474]: WARNING cinder.quota [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-873875237 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-873875237, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:08:20 devstack cinder-volume[87474]: WARNING cinder.quota [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-873875237 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-873875237, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Created reservations ['d8fd4b79-5147-493a-9a4a-e6a42c67c8d4', '9eec1822-7aab-4028-bbdc-dfdd0ee7ed67', '506ce2d3-213e-4130-bf93-5caf875774fc', '7701cb28-7b85-4130-a55e-0957dee08a2f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:20 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:08:20 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:20 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.275s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:08:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Deleted volume successfully.
Sep 06 17:08:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0498f05-37fe-4ae2-80df-9d2a81cfc87b tempest-VolumeTypesAccessTest-196411761 None] Lock "cinder-5d656821-fbb4-43c8-8ea2-508f95fc98f7-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "cinder-696ae107-0b92-4922-8342-7cd006f35662-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "cinder-696ae107-0b92-4922-8342-7cd006f35662-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "cinder-quobyte-696ae107-0b92-4922-8342-7cd006f35662" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "cinder-quobyte-696ae107-0b92-4922-8342-7cd006f35662" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cab977-1f9d-49cb-88aa-9250d6c4b5b4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:24 devstack sudo[99762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662
Sep 06 17:08:24 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:24 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662" returned: 0 in 0.451s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:24 devstack sudo[99768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662
Sep 06 17:08:24 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:24 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-696ae107-0b92-4922-8342-7cd006f35662" returned: 0 in 0.302s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "cinder-quobyte-696ae107-0b92-4922-8342-7cd006f35662" released by "delete_volume" :: held 0.809s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Created reservations ['974e8adf-20e0-4099-b918-8ecfd85d92b8', '4fdc3075-e306-4e6b-bd4f-a06d81f51a77', '0d0ad2d5-cd24-4f8c-9472-3d05bc31c4ba', 'a7ab5818-fd16-4d4f-969d-e937f7f0fa71'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:24 devstack sudo[99771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:08:24 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "cinder-026badea-e955-4894-90c7-6f3a9df89f8f-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "cinder-026badea-e955-4894-90c7-6f3a9df89f8f-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "cinder-quobyte-026badea-e955-4894-90c7-6f3a9df89f8f" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "cinder-quobyte-026badea-e955-4894-90c7-6f3a9df89f8f" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c80cdef-e90e-4319-a05e-ccaa5689e4da]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:25 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.435s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:08:25 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Deleted volume successfully.
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7322e268-784c-4f61-bfb8-7b4d6e9c3c63 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "cinder-696ae107-0b92-4922-8342-7cd006f35662-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:25 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f
Sep 06 17:08:25 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:25 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f" returned: 0 in 0.388s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:25 devstack sudo[99779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f
Sep 06 17:08:25 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:25 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-026badea-e955-4894-90c7-6f3a9df89f8f" returned: 0 in 0.254s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "cinder-quobyte-026badea-e955-4894-90c7-6f3a9df89f8f" released by "delete_volume" :: held 0.698s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Created reservations ['d575785a-d490-45e3-b89a-1eededbf817e', 'f2218ffc-c5f8-4293-8c58-24523469304e', 'cf448096-676c-46c2-a482-16c9c406f3bb', '569622d5-2ff7-444e-9fe6-a029ec98a1c7'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:26 devstack sudo[99786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:26 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:26 devstack sudo[99788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:08:26 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:26 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.369s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:08:26 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.332s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:08:26 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Deleted volume successfully.
Sep 06 17:08:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-04d48a90-904d-4104-a3a0-5cbf7be60398 tempest-TestServerVolumeAttachmentScenario-1852044241 None] Lock "cinder-026badea-e955-4894-90c7-6f3a9df89f8f-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:29 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-1ad15d4e-f028-4749-affe-c6ba5f299a9c req-5869c0cb-b6a2-45d1-abe0-b2997f31b6ca tempest-TestMinimumBasicScenario-976761781 None] Terminate volume connection completed successfully.
Sep 06 17:08:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-1ad15d4e-f028-4749-affe-c6ba5f299a9c req-5869c0cb-b6a2-45d1-abe0-b2997f31b6ca tempest-TestMinimumBasicScenario-976761781 None] Deleting attachment 7f7fd0b4-0f8d-44ee-9401-94ecbd67fce1. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:08:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Acquiring lock "cinder-544b595b-c3de-44fd-b1f9-43b24604704d-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Lock "cinder-544b595b-c3de-44fd-b1f9-43b24604704d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Acquiring lock "cinder-quobyte-544b595b-c3de-44fd-b1f9-43b24604704d" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Lock "cinder-quobyte-544b595b-c3de-44fd-b1f9-43b24604704d" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:30 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a3139a-2de5-48fc-8ef9-57bd67d5a9dc]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:30 devstack sudo[99811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d
Sep 06 17:08:30 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:31 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d" returned: 0 in 0.411s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:31 devstack sudo[99816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d
Sep 06 17:08:31 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:31 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-544b595b-c3de-44fd-b1f9-43b24604704d" returned: 0 in 0.325s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Lock "cinder-quobyte-544b595b-c3de-44fd-b1f9-43b24604704d" released by "delete_volume" :: held 0.801s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Created reservations ['da96283d-5657-4a9f-bbed-cace334abe4c', 'da914b5f-9b07-4759-955b-79d5d048fe1e', '349bfc0f-f1bc-4984-b8c1-0366e7013e3f', 'dc5b3956-8e30-4918-9e95-0cb61434d595'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:31 devstack sudo[99821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:08:31 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:32 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.463s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:32 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:08:32 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Deleted volume successfully.
Sep 06 17:08:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f7850c2e-45fa-46f7-94db-21084552f967 tempest-TestMinimumBasicScenario-976761781 None] Lock "cinder-544b595b-c3de-44fd-b1f9-43b24604704d-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Flow 'volume_create_manager' (8b2d2346-6199-4f9b-b585-c6ed57d28de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac14caf-570f-4e01-b74d-12913a788f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eac14caf-570f-4e01-b74d-12913a788f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1713280846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3e10c3-8003-4a62-b72f-70edc99d7fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5006f43db448f1a97cc01f5ed62f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:35Z,use_quota=True,user_id='b3851a86da164ba1a0147d6f3b25f994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a5e5c6-5d9e-428f-bc4e-1853ff403a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a5e5c6-5d9e-428f-bc4e-1853ff403a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcc7380-1e74-4088-aa05-7fee300b64c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcc7380-1e74-4088-aa05-7fee300b64c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b3e10c3-8003-4a62-b72f-70edc99d7fbf', 'volume_name': 'volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cb0b14-0733-4451-a6b3-e3a1facbf282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4cb0b14-0733-4451-a6b3-e3a1facbf282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07da1e8-0d69-4b20-937b-86604e13d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Volume 2b3e10c3-8003-4a62-b72f-70edc99d7fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf', 'volume_size': 1}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1713280846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3e10c3-8003-4a62-b72f-70edc99d7fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae5006f43db448f1a97cc01f5ed62f49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:35Z,use_quota=True,user_id='b3851a86da164ba1a0147d6f3b25f994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Creating volume 2b3e10c3-8003-4a62-b72f-70edc99d7fbf {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:08:35 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:08:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:35 devstack sudo[99847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf 1073741824
Sep 06 17:08:35 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:36 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf 1073741824" returned: 0 in 0.601s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:36 devstack sudo[99853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf
Sep 06 17:08:36 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:36 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" returned: 0 in 0.333s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:08:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e07da1e8-0d69-4b20-937b-86604e13d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0eb07e-fc7a-4859-83e6-8845384d9b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:36 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Volume volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf (2b3e10c3-8003-4a62-b72f-70edc99d7fbf): created successfully
Sep 06 17:08:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0eb07e-fc7a-4859-83e6-8845384d9b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Flow 'volume_create_manager' (8b2d2346-6199-4f9b-b585-c6ed57d28de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-334775bc-c6b7-400e-b34f-aa2108f7d461 tempest-SnapshotMetadataTestJSON-696979700 None] Created volume successfully.
Sep 06 17:08:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Creating offline snapshot e8770b60-7f15-4eb8-8adf-a1a7afc58999 of volume 2b3e10c3-8003-4a62-b72f-70edc99d7fbf {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:08:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d8e68c-9516-4b18-afff-3fa9848e7786]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:37 devstack sudo[99858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf
Sep 06 17:08:37 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:38 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" returned: 0 in 0.409s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:38 devstack sudo[99864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 1G
Sep 06 17:08:38 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:38 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 1G" returned: 0 in 0.497s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:38 devstack sudo[99870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999
Sep 06 17:08:38 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:39 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999" returned: 0 in 0.327s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:39 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 is being set with open permissions: ugo+rw
Sep 06 17:08:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:39 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999
Sep 06 17:08:39 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:39 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999" returned: 0 in 0.269s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:39 devstack sudo[99878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.info
Sep 06 17:08:39 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:39 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.info" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:39 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.info is being set with open permissions: ugo+rw
Sep 06 17:08:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:39 devstack sudo[99881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.info
Sep 06 17:08:39 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:40 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.info" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7f88ed5d-1bd0-4da4-8287-1ef42a8c4fdc tempest-SnapshotMetadataTestJSON-696979700 None] Create snapshot completed successfully
Sep 06 17:08:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Acquiring lock "cinder-e8770b60-7f15-4eb8-8adf-a1a7afc58999-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-e8770b60-7f15-4eb8-8adf-a1a7afc58999-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Acquiring lock "cinder-quobyte-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-quobyte-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Acquiring lock "cinder-quobyte-e8770b60-7f15-4eb8-8adf-a1a7afc58999" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-quobyte-e8770b60-7f15-4eb8-8adf-a1a7afc58999" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Deleting offline snapshot e8770b60-7f15-4eb8-8adf-a1a7afc58999 of volume 2b3e10c3-8003-4a62-b72f-70edc99d7fbf {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:08:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] snapshot_file for this snap is: volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:08:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fde44b0-ea62-40a4-9fb5-8de4ce9a56e2]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:42 devstack sudo[99887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999
Sep 06 17:08:42 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:42 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999" returned: 0 in 0.446s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:08:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fa8b70-ce43-4e4c-b07a-b2e587ba6742]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:42 devstack sudo[99893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf
Sep 06 17:08:42 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:42 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" returned: 0 in 0.398s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:42 devstack sudo[99898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999
Sep 06 17:08:42 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:43 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999" returned: 0 in 0.406s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:43 devstack sudo[99905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999
Sep 06 17:08:43 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:43 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf.e8770b60-7f15-4eb8-8adf-a1a7afc58999" returned: 0 in 0.292s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-quobyte-e8770b60-7f15-4eb8-8adf-a1a7afc58999" released by "_delete_snapshot" :: held 1.670s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-quobyte-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" released by "delete_snapshot" :: held 1.695s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:43 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Created reservations ['e844fc15-bdc5-4e4c-a221-1650c4f3ff60', 'ec9d0ef0-f254-4d9d-8ed6-1b6be7035b7f', 'dfe017e7-22ef-42f4-998b-68b403fe65d3', 'd0a56e2c-7e2a-4cf2-9800-693e61d1839e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:08:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Delete snapshot completed successfully.
Sep 06 17:08:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5ebaed38-483d-4336-980b-c70764f276e6 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-e8770b60-7f15-4eb8-8adf-a1a7afc58999-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Acquiring lock "cinder-2b3e10c3-8003-4a62-b72f-70edc99d7fbf-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-2b3e10c3-8003-4a62-b72f-70edc99d7fbf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Acquiring lock "cinder-quobyte-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-quobyte-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:44 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eee53f5-343c-4dc9-acaa-56e8317da47c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:44 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf
Sep 06 17:08:44 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:44 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" returned: 0 in 0.427s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:44 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf
Sep 06 17:08:44 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:45 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-quobyte-2b3e10c3-8003-4a62-b72f-70edc99d7fbf" released by "delete_volume" :: held 0.762s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Created reservations ['de0b72ca-88ae-443c-a7a0-d8b27f797df5', 'f9bbfcc7-2e97-43ef-af15-cb8c28b874e3', 'b5ad0c9a-b8d1-4cf4-9218-cd96c2ad555d', 'a4174bf2-6953-4ef7-be9e-af3c92b015d7'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:45 devstack sudo[99917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:08:45 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:45 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:08:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Deleted volume successfully.
Sep 06 17:08:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-301638be-f64d-4eb1-b12c-255838287619 tempest-SnapshotMetadataTestJSON-696979700 None] Lock "cinder-2b3e10c3-8003-4a62-b72f-70edc99d7fbf-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Flow 'volume_create_manager' (9068becc-f616-4c0a-b697-6932c8082a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9719e53-1e4f-4687-821e-5416f2e21bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9719e53-1e4f-4687-821e-5416f2e21bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1790790091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b980587a-ee74-4e5e-b149-a7dc4e1d9e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb960eab635f4baea0b6cc35f896d498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:51Z,use_quota=True,user_id='8a2719724e1f4400a0ad7b2bddb1e489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3f8a9e-0847-4d9b-aa48-a55ff0d90eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3f8a9e-0847-4d9b-aa48-a55ff0d90eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86babdde-8770-4842-b926-fc1363d1d807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86babdde-8770-4842-b926-fc1363d1d807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b980587a-ee74-4e5e-b149-a7dc4e1d9e8b', 'volume_name': 'volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a41da8-8df5-4960-a6ea-1ea049462bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a41da8-8df5-4960-a6ea-1ea049462bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be29cec3-9154-4d22-b2f1-2e8d1540fccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:50 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Volume b980587a-ee74-4e5e-b149-a7dc4e1d9e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b', 'volume_size': 1}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1790790091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b980587a-ee74-4e5e-b149-a7dc4e1d9e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb960eab635f4baea0b6cc35f896d498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:51Z,use_quota=True,user_id='8a2719724e1f4400a0ad7b2bddb1e489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Creating volume b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:08:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:08:51 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:51 devstack sudo[99921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b 1073741824
Sep 06 17:08:51 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:51 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b 1073741824" returned: 0 in 0.615s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:51 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b
Sep 06 17:08:51 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (d7e44141-6173-4f15-ad3b-3589c9e74528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83cd835-871e-4498-b8d4-e141318c0f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83cd835-871e-4498-b8d4-e141318c0f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696508022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5160782-062c-4534-a971-65de7edd62ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:52Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc86ea56-58f4-4a4e-b803-c0f7f614f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc86ea56-58f4-4a4e-b803-c0f7f614f27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d57276-a980-4088-a3e1-81e18287cd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d57276-a980-4088-a3e1-81e18287cd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5160782-062c-4534-a971-65de7edd62ac', 'volume_name': 'volume-c5160782-062c-4534-a971-65de7edd62ac', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:51 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee84f3d2-e05f-4991-8d2a-fc4ce052f536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee84f3d2-e05f-4991-8d2a-fc4ce052f536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6e0a3f-f9d6-4c3c-96bb-3f958ac52d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Volume c5160782-062c-4534-a971-65de7edd62ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5160782-062c-4534-a971-65de7edd62ac', 'volume_size': 1}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:52 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" returned: 0 in 0.395s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.070s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696508022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5160782-062c-4534-a971-65de7edd62ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:52Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Creating volume c5160782-062c-4534-a971-65de7edd62ac {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:08:52 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:52 devstack sudo[99931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac 1073741824
Sep 06 17:08:52 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be29cec3-9154-4d22-b2f1-2e8d1540fccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e804c23c-c9cb-4887-b59e-675c45552442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Volume volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b (b980587a-ee74-4e5e-b149-a7dc4e1d9e8b): created successfully
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e804c23c-c9cb-4887-b59e-675c45552442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Flow 'volume_create_manager' (9068becc-f616-4c0a-b697-6932c8082a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:52 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c5d9f0f3-5ec9-4c6d-86ad-e2a59a4ed988 tempest-VolumesDeleteCascade-15191882 None] Created volume successfully.
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (b990e39b-6bdc-4710-be18-98718d9a17eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (425f661c-2d27-431c-8dd3-6d1cee10ef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (425f661c-2d27-431c-8dd3-6d1cee10ef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683675551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a2f23f-18fc-4106-826e-0decf028753e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:52Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58c37d5-7250-44c7-a89c-9b6842337a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58c37d5-7250-44c7-a89c-9b6842337a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b834d0-ef17-49c2-a8bb-78ecb46e71bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b834d0-ef17-49c2-a8bb-78ecb46e71bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a2f23f-18fc-4106-826e-0decf028753e', 'volume_name': 'volume-78a2f23f-18fc-4106-826e-0decf028753e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68662cfa-6bf1-48e7-b060-5812ff99c15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68662cfa-6bf1-48e7-b060-5812ff99c15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ff9070-6028-4d28-98c6-4b6108dbf1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Volume 78a2f23f-18fc-4106-826e-0decf028753e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a2f23f-18fc-4106-826e-0decf028753e', 'volume_size': 1}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:52 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac 1073741824" returned: 0 in 0.599s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:52 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac
Sep 06 17:08:52 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (3bbf976a-0ff1-48da-996c-0ae3f9b70699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd6022b-2373-4966-a003-c8772f1ce2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd6022b-2373-4966-a003-c8772f1ce2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831034760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ddc2da-6683-4664-9365-c272b12aaaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:53Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5427d2-f6b0-485c-bbf7-5c8f2f1a681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5427d2-f6b0-485c-bbf7-5c8f2f1a681f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee39ec7f-c8a6-4a9c-b64b-05c27ff8bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee39ec7f-c8a6-4a9c-b64b-05c27ff8bebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ddc2da-6683-4664-9365-c272b12aaaf7', 'volume_name': 'volume-c2ddc2da-6683-4664-9365-c272b12aaaf7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c84a6-9335-4e1f-86c2-f9204616cd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (386c84a6-9335-4e1f-86c2-f9204616cd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45787c8a-a14c-4248-bff8-f70d38cac897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:52 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Volume c2ddc2da-6683-4664-9365-c272b12aaaf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ddc2da-6683-4664-9365-c272b12aaaf7', 'volume_size': 1}
Sep 06 17:08:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:53 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1683675551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a2f23f-18fc-4106-826e-0decf028753e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:52Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Creating volume 78a2f23f-18fc-4106-826e-0decf028753e {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:08:53 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:53 devstack sudo[99940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e 1073741824
Sep 06 17:08:53 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d6e0a3f-f9d6-4c3c-96bb-3f958ac52d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5160782-062c-4534-a971-65de7edd62ac', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df03f3f-60ec-45b8-a96d-c1a8c6a2409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:53 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Volume volume-c5160782-062c-4534-a971-65de7edd62ac (c5160782-062c-4534-a971-65de7edd62ac): created successfully
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df03f3f-60ec-45b8-a96d-c1a8c6a2409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (d7e44141-6173-4f15-ad3b-3589c9e74528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:53 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c5c99051-6462-47db-8af0-ecf4b89cfac6 tempest-CreateVolumesFromImageTest-877646506 None] Created volume successfully.
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (51777948-2101-4e91-b90f-327d4b70801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595c192e-3742-479a-83c0-f81f41844041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595c192e-3742-479a-83c0-f81f41844041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370393036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0616a5d-6361-4f53-b872-bbd8a27f2b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:53Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69cda717-4bd9-46db-a707-4ac4d2855596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69cda717-4bd9-46db-a707-4ac4d2855596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d024dd-1977-4085-978c-fb07a59bf738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73d024dd-1977-4085-978c-fb07a59bf738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0616a5d-6361-4f53-b872-bbd8a27f2b8a', 'volume_name': 'volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbae6802-1e9e-4a41-8b84-7567fcc7a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbae6802-1e9e-4a41-8b84-7567fcc7a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e31f64-1903-4edb-a81e-6daff6f1df0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:53 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Volume a0616a5d-6361-4f53-b872-bbd8a27f2b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a', 'volume_size': 1}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:53 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e 1073741824" returned: 0 in 0.627s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:53 devstack sudo[99946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e
Sep 06 17:08:53 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:08:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (7429066c-7271-401b-8675-6a5dd06f1c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0acc2fe-22c1-4b42-bdb1-12c5d5675140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0acc2fe-22c1-4b42-bdb1-12c5d5675140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644688786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c2de6a-e5ef-4ca8-9048-a9d67ccff34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:54Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ef853d-0db3-4b3e-9f81-1aaee4a5e535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ef853d-0db3-4b3e-9f81-1aaee4a5e535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19b56d3-05cf-43ea-90c9-7cc8e24225fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19b56d3-05cf-43ea-90c9-7cc8e24225fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c2de6a-e5ef-4ca8-9048-a9d67ccff34d', 'volume_name': 'volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3e079d-15d2-449e-9fbd-e2691c9e16b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3e079d-15d2-449e-9fbd-e2691c9e16b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e49156-e3b1-4e83-b7ec-0735398df466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:54 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Volume 07c2de6a-e5ef-4ca8-9048-a9d67ccff34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d', 'volume_size': 1}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:54 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e" returned: 0 in 0.267s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.167s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-831034760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ddc2da-6683-4664-9365-c272b12aaaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:53Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Creating volume c2ddc2da-6683-4664-9365-c272b12aaaf7 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:08:54 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9ff9070-6028-4d28-98c6-4b6108dbf1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a2f23f-18fc-4106-826e-0decf028753e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:54 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7 1073741824
Sep 06 17:08:54 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dc00cd-e0fb-48ce-940e-7d0768bd313a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:54 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Volume volume-78a2f23f-18fc-4106-826e-0decf028753e (78a2f23f-18fc-4106-826e-0decf028753e): created successfully
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dc00cd-e0fb-48ce-940e-7d0768bd313a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (b990e39b-6bdc-4710-be18-98718d9a17eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-891719f5-8bb7-468c-81df-367dfe442d23 tempest-CreateVolumesFromImageTest-877646506 None] Created volume successfully.
Sep 06 17:08:54 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7 1073741824" returned: 0 in 0.456s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:54 devstack sudo[99955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7
Sep 06 17:08:54 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:54 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.146s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1370393036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0616a5d-6361-4f53-b872-bbd8a27f2b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:53Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Creating volume a0616a5d-6361-4f53-b872-bbd8a27f2b8a {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:08:54 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45787c8a-a14c-4248-bff8-f70d38cac897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ddc2da-6683-4664-9365-c272b12aaaf7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:54 devstack sudo[99958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a 1073741824
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6755ab03-a089-4648-b73b-435e5d64a58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:54 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:54 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Volume volume-c2ddc2da-6683-4664-9365-c272b12aaaf7 (c2ddc2da-6683-4664-9365-c272b12aaaf7): created successfully
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6755ab03-a089-4648-b73b-435e5d64a58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (3bbf976a-0ff1-48da-996c-0ae3f9b70699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e583c9bf-e51a-4730-9bfe-b192d29fbe77 tempest-CreateVolumesFromImageTest-877646506 None] Created volume successfully.
Sep 06 17:08:55 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a 1073741824" returned: 0 in 0.462s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:55 devstack sudo[99963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a
Sep 06 17:08:55 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:55 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a" returned: 0 in 0.245s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.888s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Creating offline snapshot 9bd58e94-9ea3-418c-8238-c58e32852fc4 of volume b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e31f64-1903-4edb-a81e-6daff6f1df0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c3ed65-cb3b-4eda-9820-8b116a9c3e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d601e79-ad70-4fb7-8b0f-532b003fc3bd]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:55 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Volume volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a (a0616a5d-6361-4f53-b872-bbd8a27f2b8a): created successfully
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c3ed65-cb3b-4eda-9820-8b116a9c3e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (51777948-2101-4e91-b90f-327d4b70801b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8e932840-a008-4553-b955-000bce784900 tempest-CreateVolumesFromImageTest-877646506 None] Created volume successfully.
Sep 06 17:08:55 devstack sudo[99966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b
Sep 06 17:08:55 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:56 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" returned: 0 in 0.396s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:56 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 1G
Sep 06 17:08:56 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:56 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 1G" returned: 0 in 0.435s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:56 devstack sudo[99977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4
Sep 06 17:08:56 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:56 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4" returned: 0 in 0.377s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:56 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 is being set with open permissions: ugo+rw
Sep 06 17:08:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:56 devstack sudo[99982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4
Sep 06 17:08:56 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:57 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4" returned: 0 in 0.258s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:57 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.info
Sep 06 17:08:57 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:57 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.info" returned: 0 in 0.280s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:57 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.info is being set with open permissions: ugo+rw
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:57 devstack sudo[99988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.info
Sep 06 17:08:57 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:57 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.info" returned: 0 in 0.270s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.726s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1644688786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c2de6a-e5ef-4ca8-9048-a9d67ccff34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e543c95074f669915c81dbc0bae3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:08:54Z,use_quota=True,user_id='c3491bce4cb04a18972290913118e064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Creating volume 07c2de6a-e5ef-4ca8-9048-a9d67ccff34d {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:08:57 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:08:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:57 devstack sudo[99991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d 1073741824
Sep 06 17:08:57 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:57 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-84659ced-ef8d-46d0-ac15-09a9e7e7a747 tempest-VolumesDeleteCascade-15191882 None] Create snapshot completed successfully
Sep 06 17:08:58 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d 1073741824" returned: 0 in 0.562s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:58 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d
Sep 06 17:08:58 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:58 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d" returned: 0 in 0.283s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e49156-e3b1-4e83-b7ec-0735398df466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f6329b-1ea9-4e87-9ff7-55515dff783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:08:58 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Volume volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d (07c2de6a-e5ef-4ca8-9048-a9d67ccff34d): created successfully
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f6329b-1ea9-4e87-9ff7-55515dff783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Flow 'volume_create_manager' (7429066c-7271-401b-8675-6a5dd06f1c9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:08:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-96ae6232-0bf6-437f-916b-de4a707b46ae tempest-CreateVolumesFromImageTest-877646506 None] Created volume successfully.
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Creating offline snapshot d3416e88-d86f-4f09-ab56-8f16c90a07b9 of volume b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:08:58 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed081fe7-00c7-4fea-bf3d-ac6c7ac758e2]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:59 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4
Sep 06 17:08:59 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:59 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4" returned: 0 in 0.383s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:59 devstack sudo[100006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 1G
Sep 06 17:08:59 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-quobyte-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e24b4ff-135f-4ac7-a299-2d2a7840df1f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:59 devstack sudo[100011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d
Sep 06 17:08:59 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:08:59 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 1G" returned: 0 in 0.523s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:08:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:08:59 devstack sudo[100014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9
Sep 06 17:08:59 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:00 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d" returned: 0 in 0.426s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:00 devstack sudo[100019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d
Sep 06 17:09:00 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:00 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9" returned: 0 in 0.405s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:00 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 is being set with open permissions: ugo+rw
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:00 devstack sudo[100058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9
Sep 06 17:09:00 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:00 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d" returned: 0 in 0.405s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d" released by "delete_volume" :: held 0.876s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:00 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9" returned: 0 in 0.272s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Created reservations ['df21b9e8-d38e-4dcc-a4e8-f245dab327e2', 'd1cfdee8-97c7-4826-b869-21e06bb8989c', '260b488e-b96b-4ff6-b2c9-01679d3067ce', '4b4c44b7-0f23-4810-bcd6-d87688ed04c9'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.720s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9b94c36c-4fd7-4564-9368-3e5ba85a143d tempest-VolumesDeleteCascade-15191882 None] Create snapshot completed successfully
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:00 devstack sudo[100064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:00 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:01 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.272s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:01 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Deleted volume successfully.
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-91ed4937-4415-4f60-9f98-bbcea1b677d6 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-07c2de6a-e5ef-4ca8-9048-a9d67ccff34d-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Performing cascade delete. {{(pid=87474) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-9bd58e94-9ea3-418c-8238-c58e32852fc4-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-9bd58e94-9ea3-418c-8238-c58e32852fc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-9bd58e94-9ea3-418c-8238-c58e32852fc4" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-9bd58e94-9ea3-418c-8238-c58e32852fc4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Deleting offline snapshot 9bd58e94-9ea3-418c-8238-c58e32852fc4 of volume b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] snapshot_file for this snap is: volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dd7d52-0477-4d97-8c36-c9a13146322a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:01 devstack sudo[100067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4
Sep 06 17:09:01 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:01 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4" returned: 0 in 0.383s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20643c1-f576-41c3-b165-1cd1d391c633]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-a0616a5d-6361-4f53-b872-bbd8a27f2b8a-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-a0616a5d-6361-4f53-b872-bbd8a27f2b8a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:01 devstack sudo[100073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b
Sep 06 17:09:01 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-quobyte-a0616a5d-6361-4f53-b872-bbd8a27f2b8a" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-a0616a5d-6361-4f53-b872-bbd8a27f2b8a" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb2e731-efbd-4ece-af1a-967af49feeb6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:02 devstack sudo[100075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a
Sep 06 17:09:02 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:02 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" returned: 0 in 0.513s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbc80a6-223a-42f8-a985-74e95aaeb20e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:02 devstack sudo[100080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9
Sep 06 17:09:02 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:02 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a" returned: 0 in 0.463s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:02 devstack sudo[100086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a
Sep 06 17:09:02 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:02 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a0616a5d-6361-4f53-b872-bbd8a27f2b8a" returned: 0 in 0.280s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-a0616a5d-6361-4f53-b872-bbd8a27f2b8a" released by "delete_volume" :: held 0.797s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Flow 'volume_create_manager' (647d0967-e9b1-44cc-a71b-2dcc3374c6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:02 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999f3fe0-faa6-4f58-aa9a-c69e8320d5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9" returned: 0 in 0.478s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999f3fe0-faa6-4f58-aa9a-c69e8320d5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1608698952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7863d3-44ac-4773-8c2f-1639694080b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc604cdf7ec41fb8101bbf31142fd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:03Z,use_quota=True,user_id='8e5ab2071206457ca1381650db84a110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb44fc4-6ce1-4821-8465-fb9803102c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb44fc4-6ce1-4821-8465-fb9803102c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658aa0f5-e533-4d9d-a4d9-831f68fa923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658aa0f5-e533-4d9d-a4d9-831f68fa923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b7863d3-44ac-4773-8c2f-1639694080b6', 'volume_name': 'volume-1b7863d3-44ac-4773-8c2f-1639694080b6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6393ff-399d-41f3-abc3-767f88fdf11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6393ff-399d-41f3-abc3-767f88fdf11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0a6237-a062-4c9b-b9cf-c685400b33aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Volume 1b7863d3-44ac-4773-8c2f-1639694080b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b7863d3-44ac-4773-8c2f-1639694080b6', 'volume_size': 1}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1608698952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7863d3-44ac-4773-8c2f-1639694080b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc604cdf7ec41fb8101bbf31142fd02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:03Z,use_quota=True,user_id='8e5ab2071206457ca1381650db84a110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Creating volume 1b7863d3-44ac-4773-8c2f-1639694080b6 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:02 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ce511b-f634-4297-abb7-0aee6dffb85c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:02 devstack sudo[100092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 1073741824
Sep 06 17:09:02 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:02 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Created reservations ['5f970536-d589-4ba5-a925-bafb0d3e4589', '6904bc98-2859-496c-bcf9-acea5a59f800', '7c1210b1-b7c1-4c78-b3f1-94b19ee4b7c4', '09cacf3d-243d-4cfe-b4b4-0d36aeccedf1'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:03 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4
Sep 06 17:09:03 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:03 devstack sudo[100096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:03 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-c2ddc2da-6683-4664-9365-c272b12aaaf7-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-c2ddc2da-6683-4664-9365-c272b12aaaf7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-quobyte-c2ddc2da-6683-4664-9365-c272b12aaaf7" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-c2ddc2da-6683-4664-9365-c272b12aaaf7" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e839f9b6-c345-42aa-95ea-b5a5dcef7076]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:03 devstack sudo[100101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7
Sep 06 17:09:03 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:03 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.395s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:03 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4" returned: 0 in 0.543s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:09:03 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Deleted volume successfully.
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b43878-4161-49ac-b632-4fd367d407f7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:03 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 1073741824" returned: 0 in 0.595s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cce3ec29-d17a-4ac8-8869-c13113eced62 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-a0616a5d-6361-4f53-b872-bbd8a27f2b8a-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:03 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6
Sep 06 17:09:03 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:03 devstack sudo[100108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b
Sep 06 17:09:03 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:03 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7" returned: 0 in 0.480s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:03 devstack sudo[100115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7
Sep 06 17:09:03 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:03 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6" returned: 0 in 0.257s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da0a6237-a062-4c9b-b9cf-c685400b33aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7863d3-44ac-4773-8c2f-1639694080b6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed731a4-b231-4314-8e41-33d73b0c3f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:03 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Volume volume-1b7863d3-44ac-4773-8c2f-1639694080b6 (1b7863d3-44ac-4773-8c2f-1639694080b6): created successfully
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed731a4-b231-4314-8e41-33d73b0c3f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Flow 'volume_create_manager' (647d0967-e9b1-44cc-a71b-2dcc3374c6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:03 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7eefe881-472e-42f0-a92f-a87d1148db4a tempest-TestImageHashVerification-1053805083 None] Created volume successfully.
Sep 06 17:09:03 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" returned: 0 in 0.411s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:03 devstack sudo[100121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4
Sep 06 17:09:03 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:03 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2ddc2da-6683-4664-9365-c272b12aaaf7" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-c2ddc2da-6683-4664-9365-c272b12aaaf7" released by "delete_volume" :: held 0.784s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Created reservations ['00db1d6a-8414-4e71-882f-d1138a7e8f7c', 'a6ddb3a9-ceb0-46f6-88d0-dbd9818aa7a2', 'e3ca2824-6ead-435b-abd9-c0f0acd97fef', '10f5958c-851a-4b58-95b9-2acd27601590'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:04 devstack sudo[100127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:04 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:04 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4" returned: 0 in 0.362s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:04 devstack sudo[100130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4
Sep 06 17:09:04 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-78a2f23f-18fc-4106-826e-0decf028753e-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-78a2f23f-18fc-4106-826e-0decf028753e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:04 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.290s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:04 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Deleted volume successfully.
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-quobyte-78a2f23f-18fc-4106-826e-0decf028753e" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-78a2f23f-18fc-4106-826e-0decf028753e" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3154b74d-3440-495b-ac63-3a3fd32478d8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-c2ddc2da-6683-4664-9365-c272b12aaaf7-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[398a38bd-1ba6-40df-a22f-3ca3e474a06c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:04 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.9bd58e94-9ea3-418c-8238-c58e32852fc4" returned: 0 in 0.292s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 -F qcow2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:04 devstack sudo[100135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 -F qcow2
Sep 06 17:09:04 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:04 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e
Sep 06 17:09:04 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:04 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e" returned: 0 in 0.374s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:04 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 -F qcow2" returned: 0 in 0.341s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:04 devstack sudo[100144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e
Sep 06 17:09:04 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-9bd58e94-9ea3-418c-8238-c58e32852fc4" released by "_delete_snapshot" :: held 3.642s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" released by "delete_snapshot" :: held 3.683s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Created reservations ['0d5979e1-a2d7-4b94-93b3-fd6d2ebb98d7', 'eaf6fab4-b724-478b-b967-443412394cd6', 'fdd78a85-59dd-4319-a784-5ab28d42d53b', '10ecb4bd-c88b-4ee7-91b8-b36c65c6a62f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Delete snapshot completed successfully.
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-9bd58e94-9ea3-418c-8238-c58e32852fc4-delete_snapshot" released by "delete_snapshot" :: held 3.860s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-d3416e88-d86f-4f09-ab56-8f16c90a07b9-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-d3416e88-d86f-4f09-ab56-8f16c90a07b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-d3416e88-d86f-4f09-ab56-8f16c90a07b9" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-d3416e88-d86f-4f09-ab56-8f16c90a07b9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Deleting offline snapshot d3416e88-d86f-4f09-ab56-8f16c90a07b9 of volume b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] snapshot_file for this snap is: volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:09:05 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-78a2f23f-18fc-4106-826e-0decf028753e" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d719bc0-3e4e-453e-a88b-a2cc26992622]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-78a2f23f-18fc-4106-826e-0decf028753e" released by "delete_volume" :: held 0.717s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Created reservations ['6eab5585-5e52-4c7b-bd2d-f4d833072cb3', 'd8c30c41-2b68-4ff8-9e2a-efb6a9b4f4b1', 'd3510525-36e6-4e42-81b9-327efa58308e', 'd1404072-5e2f-433e-9dca-93168ada988e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:05 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9
Sep 06 17:09:05 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:05 devstack sudo[100149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:05 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:05 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9" returned: 0 in 0.410s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-c5160782-062c-4534-a971-65de7edd62ac-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[be410cd6-f629-4562-9366-f56ad44c47e2]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:05 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-c5160782-062c-4534-a971-65de7edd62ac-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.331s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Deleted volume successfully.
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6656d0b2-b01c-40d7-bfdf-9040795a87ff tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-78a2f23f-18fc-4106-826e-0decf028753e-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "cinder-quobyte-c5160782-062c-4534-a971-65de7edd62ac" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-c5160782-062c-4534-a971-65de7edd62ac" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a58f614-53e7-4f0d-af14-8aab5cd32ef0]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:05 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b
Sep 06 17:09:05 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:05 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:05 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b19710-3959-4f73-b97a-ca2881f1363c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:06 devstack sudo[100159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6
Sep 06 17:09:06 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:06 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" returned: 0 in 0.394s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:06 devstack sudo[100164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9
Sep 06 17:09:06 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:06 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac" returned: 0 in 0.396s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:06 devstack sudo[100169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac
Sep 06 17:09:06 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:06 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9f2817-642d-4828-80d1-76a2961ca669]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:06 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:06 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9" returned: 0 in 0.367s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:06 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6
Sep 06 17:09:06 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5160782-062c-4534-a971-65de7edd62ac" returned: 0 in 0.259s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-quobyte-c5160782-062c-4534-a971-65de7edd62ac" released by "delete_volume" :: held 0.704s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:06 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9
Sep 06 17:09:06 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Created reservations ['0e1f6979-237d-40f9-92ba-10b35d3c7f43', '52190b9f-2fd2-4a6d-8f55-47dfd04ca861', '827a7610-409e-4b21-bb4d-32ed4447e70a', '7d9e6a41-fae0-46ef-8c53-1463f86bee45'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:06 devstack sudo[100182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:06 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:06 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b.d3416e88-d86f-4f09-ab56-8f16c90a07b9" returned: 0 in 0.262s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:06 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-d3416e88-d86f-4f09-ab56-8f16c90a07b9" released by "_delete_snapshot" :: held 1.595s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6" returned: 0 in 0.421s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 /opt/stack/data/cinder/conversion/1b7863d3-44ac-4773-8c2f-1639694080b6.temp_image.e552f1e6-e2b9-4597-be8f-a58652845e58ob5nuh_1.img {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" released by "delete_snapshot" :: held 1.627s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:06 devstack sudo[100189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 /opt/stack/data/cinder/conversion/1b7863d3-44ac-4773-8c2f-1639694080b6.temp_image.e552f1e6-e2b9-4597-be8f-a58652845e58ob5nuh_1.img
Sep 06 17:09:06 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Created reservations ['64948428-0366-4b8b-96da-ef8a4149736a', '727cf199-3b63-4aa9-bc90-fb6f53718f2d', '1e4170a5-aa06-46fb-a990-006293fd51a2', 'bd2ca23c-0c54-48ea-90ed-11481021c75b'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:06 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.269s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Deleted volume successfully.
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1224e95a-c6a2-4b5b-bf1f-3a4b684e83a8 tempest-CreateVolumesFromImageTest-877646506 None] Lock "cinder-c5160782-062c-4534-a971-65de7edd62ac-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Delete snapshot completed successfully.
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-d3416e88-d86f-4f09-ab56-8f16c90a07b9-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Snapshots deleted, issuing volume delete {{(pid=87474) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8864af4-8801-489d-8616-4f5672b7c05f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:07 devstack sudo[100192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b
Sep 06 17:09:07 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:07 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" returned: 0 in 0.875s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:07 devstack sudo[100208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b
Sep 06 17:09:07 devstack sudo[100208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:08 devstack sudo[100208]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" returned: 0 in 0.695s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b" released by "delete_volume" :: held 1.676s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:08 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Created reservations ['629cc7a8-dd45-4579-bd3c-3bbe53eebe49', '4c07dc9c-04fb-4bd0-bad9-61954c1e4df9', '2c9ef360-c19b-4e3b-9dd3-3be4e02aa74d', '60643932-80f6-4db1-a7c5-47706c54572d'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:09 devstack sudo[100213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:09 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:09 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.583s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:09 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:09 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Deleted volume successfully.
Sep 06 17:09:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c54c1cc9-b926-4ea3-a371-ee97e812df6d tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-b980587a-ee74-4e5e-b149-a7dc4e1d9e8b-delete_volume" released by "delete_volume" :: held 8.596s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:11 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 /opt/stack/data/cinder/conversion/1b7863d3-44ac-4773-8c2f-1639694080b6.temp_image.e552f1e6-e2b9-4597-be8f-a58652845e58ob5nuh_1.img" returned: 0 in 5.013s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:11 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e0d01c-11d7-43c5-b1de-9345a4a336e4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:11 devstack sudo[100217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6
Sep 06 17:09:11 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Flow 'volume_create_manager' (bb8c5661-39bd-4419-8ab2-f9145b62a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79442008-4154-47f3-b16d-febce3e76029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79442008-4154-47f3-b16d-febce3e76029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1709760071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69989fbf-0df2-4d21-a25f-b754380eed6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb960eab635f4baea0b6cc35f896d498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:12Z,use_quota=True,user_id='8a2719724e1f4400a0ad7b2bddb1e489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98e0f31-476f-4107-aa41-5c08f339093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d98e0f31-476f-4107-aa41-5c08f339093f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37a4242-ccd7-4f89-828a-1cd97abf8ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b37a4242-ccd7-4f89-828a-1cd97abf8ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69989fbf-0df2-4d21-a25f-b754380eed6c', 'volume_name': 'volume-69989fbf-0df2-4d21-a25f-b754380eed6c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dd8163-a8f9-40a4-9560-41f2b4692f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2dd8163-a8f9-40a4-9560-41f2b4692f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30215136-bfa9-4f34-a411-60f45375a084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Volume 69989fbf-0df2-4d21-a25f-b754380eed6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69989fbf-0df2-4d21-a25f-b754380eed6c', 'volume_size': 1}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:12 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6" returned: 0 in 0.552s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/conversion/1b7863d3-44ac-4773-8c2f-1639694080b6.temp_image.e552f1e6-e2b9-4597-be8f-a58652845e58ob5nuh_1.img {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:09:12 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Converted 1024.00 MB image at 204.16 MB/s
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] e552f1e6-e2b9-4597-be8f-a58652845e58 was raw, no need to convert to raw {{(pid=87474) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (c65e7fb3-8b30-44e8-b328-fb1ffef501d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7760f931-fb04-4b24-8972-f3c3b33f0139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7760f931-fb04-4b24-8972-f3c3b33f0139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1064934875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ec08a7-33ea-4f81-bf49-a61e2c7f31f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:13Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316a67df-d61a-4cce-a8b7-72d978b7bca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (316a67df-d61a-4cce-a8b7-72d978b7bca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987e2fcc-97e7-4238-91b5-54a90bea0597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987e2fcc-97e7-4238-91b5-54a90bea0597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ec08a7-33ea-4f81-bf49-a61e2c7f31f6', 'volume_name': 'volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8913af-d6ec-461b-afcc-6f79c0915931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed8913af-d6ec-461b-afcc-6f79c0915931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51280ff8-d44c-4d82-9e22-53f59577aeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:12 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume 19ec08a7-33ea-4f81-bf49-a61e2c7f31f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6', 'volume_size': 1}
Sep 06 17:09:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:22 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=116,cinder:UPDATE=131,cinder:DELETE=12,cinder:INSERT=35 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:09:22 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=146,cinder:SELECT=106,cinder:INSERT=32,cinder:DELETE=11 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:26 devstack sudo[100230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:26 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:26 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.275s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:09:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.175s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Uploaded volume to glance image-id: e552f1e6-e2b9-4597-be8f-a58652845e58. {{(pid=87474) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.927s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1709760071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69989fbf-0df2-4d21-a25f-b754380eed6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb960eab635f4baea0b6cc35f896d498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:12Z,use_quota=True,user_id='8a2719724e1f4400a0ad7b2bddb1e489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Creating volume 69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:31 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:31 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c 1073741824
Sep 06 17:09:31 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:31 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-05fc5e87-cc80-4fec-a7c1-7ebe3f9736aa tempest-TestImageHashVerification-1053805083 None] Copy volume to image completed successfully.
Sep 06 17:09:31 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c 1073741824" returned: 0 in 0.377s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:31 devstack sudo[100243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c
Sep 06 17:09:31 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:31 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c" returned: 0 in 0.237s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] <== create_volume: return (653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.021s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1064934875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ec08a7-33ea-4f81-bf49-a61e2c7f31f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:13Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Creating volume 19ec08a7-33ea-4f81-bf49-a61e2c7f31f6 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:31 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:31 devstack sudo[100247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6 1073741824
Sep 06 17:09:31 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30215136-bfa9-4f34-a411-60f45375a084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69989fbf-0df2-4d21-a25f-b754380eed6c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2471dec1-5772-4a4b-a823-d0fb7dcef3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:31 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Volume volume-69989fbf-0df2-4d21-a25f-b754380eed6c (69989fbf-0df2-4d21-a25f-b754380eed6c): created successfully
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2471dec1-5772-4a4b-a823-d0fb7dcef3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:31 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Flow 'volume_create_manager' (bb8c5661-39bd-4419-8ab2-f9145b62a95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:31 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4b90668a-96c8-4db0-a7fc-1a6338dff335 tempest-VolumesDeleteCascade-15191882 None] Created volume successfully.
Sep 06 17:09:32 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6 1073741824" returned: 0 in 0.445s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:32 devstack sudo[100253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6
Sep 06 17:09:32 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:32 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6" returned: 0 in 0.261s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.112s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Creating offline snapshot 6738a57e-6896-4075-a7ad-42549c95230a of volume 69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51280ff8-d44c-4d82-9e22-53f59577aeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5a62e5-7fe1-48f3-868a-023120c9c321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf4f395-0c82-4110-8b3e-5faf7782dca6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Acquiring lock "cinder-1b7863d3-44ac-4773-8c2f-1639694080b6-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6 (19ec08a7-33ea-4f81-bf49-a61e2c7f31f6): created successfully
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e5a62e5-7fe1-48f3-868a-023120c9c321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (c65e7fb3-8b30-44e8-b328-fb1ffef501d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Lock "cinder-1b7863d3-44ac-4773-8c2f-1639694080b6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:32 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-bd4eeef6-a3bc-4416-90ec-8f279fe83481 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created volume successfully.
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Acquiring lock "cinder-quobyte-1b7863d3-44ac-4773-8c2f-1639694080b6" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:32 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c
Sep 06 17:09:32 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Lock "cinder-quobyte-1b7863d3-44ac-4773-8c2f-1639694080b6" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10fdac0-3e71-4bd6-901f-38cb2bde2e72]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:32 devstack sudo[100258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6
Sep 06 17:09:32 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:32 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c" returned: 0 in 0.380s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:32 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a 1G
Sep 06 17:09:32 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:33 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6" returned: 0 in 0.399s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:33 devstack sudo[100269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6
Sep 06 17:09:33 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:33 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b7863d3-44ac-4773-8c2f-1639694080b6" returned: 0 in 0.323s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:33 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (53cd349c-6836-498e-b193-4b29767e74f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c405e4-30ae-4dab-bb40-b621b9148731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Lock "cinder-quobyte-1b7863d3-44ac-4773-8c2f-1639694080b6" released by "delete_volume" :: held 0.808s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a 1G" returned: 0 in 0.561s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69989fbf-0df2-4d21-a25f-b754380eed6c -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c405e4-30ae-4dab-bb40-b621b9148731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106608685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6c58eb-5760-421f-8d1d-808df28d6010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:33Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:33 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69989fbf-0df2-4d21-a25f-b754380eed6c -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a
Sep 06 17:09:33 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732d006b-2ab1-479a-9420-24df4da2c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (732d006b-2ab1-479a-9420-24df4da2c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75113d5d-8b65-44b7-99d5-dcf18702d842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75113d5d-8b65-44b7-99d5-dcf18702d842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b6c58eb-5760-421f-8d1d-808df28d6010', 'volume_name': 'volume-6b6c58eb-5760-421f-8d1d-808df28d6010', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d42453-a1c9-4fdb-9d3b-db9a9ffab5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d42453-a1c9-4fdb-9d3b-db9a9ffab5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3199d5d8-e2b8-4af3-9faa-fa25944b235e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:33 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume 6b6c58eb-5760-421f-8d1d-808df28d6010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b6c58eb-5760-421f-8d1d-808df28d6010', 'volume_size': 1}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Created reservations ['f69847c6-34e1-4469-a57d-e65ddc9d62ab', '11e0ccaf-0e91-4ab5-aae6-d703cfaf1540', 'c6ac9e32-6417-4f5c-8fa4-70202fdb09ec', 'af6f5c4c-c7e7-4ff2-81a1-6881663c4c4c'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:33 devstack sudo[100279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:33 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:33 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69989fbf-0df2-4d21-a25f-b754380eed6c -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a" returned: 0 in 0.368s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:33 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a is being set with open permissions: ugo+rw
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:33 devstack sudo[100282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a
Sep 06 17:09:33 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:33 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (bb502d7d-e428-4b93-af7d-65794ff718f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b2053d-ead1-41b5-9d7c-4c25200cad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b2053d-ead1-41b5-9d7c-4c25200cad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029736410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8f72d4-27b9-48d3-8034-c8006e36990b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:34Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923749f5-5d1a-49b3-85a2-cececd69d563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923749f5-5d1a-49b3-85a2-cececd69d563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8723490-db4a-4dab-ab00-987a86022e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8723490-db4a-4dab-ab00-987a86022e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c8f72d4-27b9-48d3-8034-c8006e36990b', 'volume_name': 'volume-8c8f72d4-27b9-48d3-8034-c8006e36990b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8fa317-09ec-4b98-9945-86eac9a7da79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc8fa317-09ec-4b98-9945-86eac9a7da79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0beea458-3405-42d2-9666-cade9b7e39d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume 8c8f72d4-27b9-48d3-8034-c8006e36990b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c8f72d4-27b9-48d3-8034-c8006e36990b', 'volume_size': 1}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.352s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Deleted volume successfully.
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-243bbf19-4ef3-4ce7-b373-41ddc2800573 tempest-TestImageHashVerification-1053805083 None] Lock "cinder-1b7863d3-44ac-4773-8c2f-1639694080b6-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:34 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a" returned: 0 in 0.357s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:34 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.info
Sep 06 17:09:34 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (2ed32357-b262-4340-8389-f449590001f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8cb3dd-cb2c-4c47-ab62-a7d0ce0e696c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8cb3dd-cb2c-4c47-ab62-a7d0ce0e696c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553291780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:34Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a5d4fa-e6e1-4c04-bd6b-a494ec381a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a5d4fa-e6e1-4c04-bd6b-a494ec381a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9a9701-1a26-4dfd-b548-5912067fdfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e9a9701-1a26-4dfd-b548-5912067fdfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3', 'volume_name': 'volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a770c65-5328-41b5-9757-da28b7979ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a770c65-5328-41b5-9757-da28b7979ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecce0c5-6cd3-48a2-894f-10dd460687ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume 2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3', 'volume_size': 1}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.info" returned: 0 in 0.300s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:34 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.info is being set with open permissions: ugo+rw
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:34 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.info
Sep 06 17:09:34 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (30e114f4-5ac5-4fe1-8b26-ff05a9153e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b81e4-dace-4452-b4cf-9d403c1eea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.info" returned: 0 in 0.301s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-106608685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6c58eb-5760-421f-8d1d-808df28d6010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:33Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Creating volume 6b6c58eb-5760-421f-8d1d-808df28d6010 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:34 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b81e4-dace-4452-b4cf-9d403c1eea9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1498575423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c79fe2-1f4a-4b85-b89e-1c0dda0e9209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:35Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3026ed60-4c05-4b9d-9881-8b59803449cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3026ed60-4c05-4b9d-9881-8b59803449cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1535b1-596c-4086-b713-77939bdc8c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010 1073741824
Sep 06 17:09:34 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1535b1-596c-4086-b713-77939bdc8c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c79fe2-1f4a-4b85-b89e-1c0dda0e9209', 'volume_name': 'volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b7c3de-d8ac-47c9-9df7-94c6e71e08da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b7c3de-d8ac-47c9-9df7-94c6e71e08da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d39f97-1ec5-4ba6-8189-337b8f7af23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume 33c79fe2-1f4a-4b85-b89e-1c0dda0e9209: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209', 'volume_size': 1}
Sep 06 17:09:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b3f91598-a017-4849-b934-239b52b2e43f tempest-VolumesDeleteCascade-15191882 None] Create snapshot completed successfully
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (4a047c2a-c02c-4722-b9e0-43d9646ea7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e48cc99-6274-4e2c-beb0-6f9b322785e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e48cc99-6274-4e2c-beb0-6f9b322785e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295233518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2981270-b060-4e3c-a226-19f8b2ef8b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:35Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4047c596-4dc5-4c2c-a4df-0a4816b99a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4047c596-4dc5-4c2c-a4df-0a4816b99a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c6f8e4-d232-41c9-a87f-ffb4b7a6b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c6f8e4-d232-41c9-a87f-ffb4b7a6b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2981270-b060-4e3c-a226-19f8b2ef8b6e', 'volume_name': 'volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c688a5b-d3ea-420e-8bcc-3efaa6aaa8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c688a5b-d3ea-420e-8bcc-3efaa6aaa8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220689dc-f18a-4ca7-904d-c6bad86aee38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume c2981270-b060-4e3c-a226-19f8b2ef8b6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e', 'volume_size': 1}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:35 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010 1073741824" returned: 0 in 0.562s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:35 devstack sudo[100298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010
Sep 06 17:09:35 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:35 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.663s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1029736410',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c8f72d4-27b9-48d3-8034-c8006e36990b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:34Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Creating volume 8c8f72d4-27b9-48d3-8034-c8006e36990b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:35 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:35 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b 1073741824
Sep 06 17:09:35 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3199d5d8-e2b8-4af3-9faa-fa25944b235e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b6c58eb-5760-421f-8d1d-808df28d6010', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a83fc24-c63e-46df-a1d7-0b832d25b6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume volume-6b6c58eb-5760-421f-8d1d-808df28d6010 (6b6c58eb-5760-421f-8d1d-808df28d6010): created successfully
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a83fc24-c63e-46df-a1d7-0b832d25b6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (53cd349c-6836-498e-b193-4b29767e74f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-928a407b-4f7a-449a-a4fb-41147fcd207f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created volume successfully.
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Flow 'volume_create_manager' (1599c53b-66ce-4257-909c-b060d38f3af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac68c04e-a09e-4032-ae58-bfd2547a3938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac68c04e-a09e-4032-ae58-bfd2547a3938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-413143695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee3f86a-67a9-46b4-b3f4-1eb8496c6b99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb960eab635f4baea0b6cc35f896d498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6738a57e-6896-4075-a7ad-42549c95230a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:36Z,use_quota=True,user_id='8a2719724e1f4400a0ad7b2bddb1e489',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de839b5-8cdc-44f0-92c8-2e04df456437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de839b5-8cdc-44f0-92c8-2e04df456437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b67140e-056b-45d5-ad55-343bd3c47e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b67140e-056b-45d5-ad55-343bd3c47e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aee3f86a-67a9-46b4-b3f4-1eb8496c6b99', 'volume_name': 'volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99', 'volume_size': 1, 'snapshot_id': '6738a57e-6896-4075-a7ad-42549c95230a'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56317453-49be-4b90-b331-e4a7ad614fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56317453-49be-4b90-b331-e4a7ad614fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596c6da5-7751-4728-b838-e5e431634cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:36 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Volume aee3f86a-67a9-46b4-b3f4-1eb8496c6b99: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99', 'volume_size': 1, 'snapshot_id': '6738a57e-6896-4075-a7ad-42549c95230a'}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:36 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b 1073741824" returned: 0 in 0.583s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:36 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b
Sep 06 17:09:36 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:36 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b" returned: 0 in 0.235s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.079s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1553291780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:34Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Creating volume 2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:36 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0beea458-3405-42d2-9666-cade9b7e39d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c8f72d4-27b9-48d3-8034-c8006e36990b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2412e6-4385-40fe-a572-bb03aa006013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:36 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3 1073741824
Sep 06 17:09:36 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:36 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume volume-8c8f72d4-27b9-48d3-8034-c8006e36990b (8c8f72d4-27b9-48d3-8034-c8006e36990b): created successfully
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2412e6-4385-40fe-a572-bb03aa006013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (bb502d7d-e428-4b93-af7d-65794ff718f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9e6b5c1c-3d59-44b7-a16b-8e7c7869ad1a tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created volume successfully.
Sep 06 17:09:37 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3 1073741824" returned: 0 in 0.445s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:37 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3
Sep 06 17:09:37 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:37 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3" returned: 0 in 0.251s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.423s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1498575423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c79fe2-1f4a-4b85-b89e-1c0dda0e9209,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:35Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Creating volume 33c79fe2-1f4a-4b85-b89e-1c0dda0e9209 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:37 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecce0c5-6cd3-48a2-894f-10dd460687ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:37 devstack sudo[100321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209 1073741824
Sep 06 17:09:37 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4d7963-061a-45da-bc1a-52d5982702f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:37 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3 (2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3): created successfully
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4d7963-061a-45da-bc1a-52d5982702f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (2ed32357-b262-4340-8389-f449590001f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b3ebccdf-3bec-4f9f-a24e-d34fca53ea60 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created volume successfully.
Sep 06 17:09:37 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209 1073741824" returned: 0 in 0.388s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:37 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209
Sep 06 17:09:37 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:38 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209" returned: 0 in 0.257s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1295233518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2981270-b060-4e3c-a226-19f8b2ef8b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de258f515024bd995b0b559a986ff20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:35Z,use_quota=True,user_id='a4549f58f50547809abfb9e15f948f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Creating volume c2981270-b060-4e3c-a226-19f8b2ef8b6e {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:38 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01d39f97-1ec5-4ba6-8189-337b8f7af23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ece339-ba50-4c65-a443-785d181e8ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:38 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e 1073741824
Sep 06 17:09:38 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:38 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209 (33c79fe2-1f4a-4b85-b89e-1c0dda0e9209): created successfully
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ece339-ba50-4c65-a443-785d181e8ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (30e114f4-5ac5-4fe1-8b26-ff05a9153e14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5cc295a1-5152-4c4b-9c4e-1a4fc33e5b0e tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created volume successfully.
Sep 06 17:09:38 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e 1073741824" returned: 0 in 0.464s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:38 devstack sudo[100337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e
Sep 06 17:09:38 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:38 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e" returned: 0 in 0.248s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.536s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-6738a57e-6896-4075-a7ad-42549c95230a-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" by "_create_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220689dc-f18a-4ca7-904d-c6bad86aee38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478a62ad-ef0e-4928-90a3-b08c4c8aa6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-6738a57e-6896-4075-a7ad-42549c95230a-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Creating volume aee3f86a-67a9-46b4-b3f4-1eb8496c6b99 from snapshot 6738a57e-6896-4075-a7ad-42549c95230a {{(pid=87474) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:38 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Volume volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e (c2981270-b060-4e3c-a226-19f8b2ef8b6e): created successfully
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478a62ad-ef0e-4928-90a3-b08c4c8aa6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Flow 'volume_create_manager' (4a047c2a-c02c-4722-b9e0-43d9646ea7c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] snapshot: 6738a57e-6896-4075-a7ad-42549c95230a, volume: aee3f86a-67a9-46b4-b3f4-1eb8496c6b99,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:09:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ca0482aa-7b33-45ff-89f7-0763bb07f737 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created volume successfully.
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a749fdd-f2b6-45fc-9d42-2bce7b88b70a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:39 devstack sudo[100341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a
Sep 06 17:09:39 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:39 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a" returned: 0 in 0.352s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69989fbf-0df2-4d21-a25f-b754380eed6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[920bf471-9692-4045-af45-b6821536c935]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:39 devstack sudo[100346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c
Sep 06 17:09:39 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:39 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c" returned: 0 in 0.375s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99 not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-c2981270-b060-4e3c-a226-19f8b2ef8b6e-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:39 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99
Sep 06 17:09:39 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-c2981270-b060-4e3c-a226-19f8b2ef8b6e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-quobyte-c2981270-b060-4e3c-a226-19f8b2ef8b6e" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-c2981270-b060-4e3c-a226-19f8b2ef8b6e" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61d6963-c34f-454b-b2ad-638449edd321]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:40 devstack sudo[100353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e
Sep 06 17:09:40 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:40 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e" returned: 0 in 0.364s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:40 devstack sudo[100366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e
Sep 06 17:09:40 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:41 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c2981270-b060-4e3c-a226-19f8b2ef8b6e" returned: 0 in 0.778s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-c2981270-b060-4e3c-a226-19f8b2ef8b6e" released by "delete_volume" :: held 1.200s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created reservations ['6664d497-82d0-4074-8ad7-ab69b775c285', '30c27553-1e1a-46b9-9ba2-f7e9e5930f22', '68bfee07-6f98-4692-80a7-f5d8887c9688', 'd942f37c-6a11-45a8-85f6-a5ec6a0eab48'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:41 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:41 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:41 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.509s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:41 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Deleted volume successfully.
Sep 06 17:09:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44d8628f-653d-46ff-997c-b2685bd5afc7 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-c2981270-b060-4e3c-a226-19f8b2ef8b6e-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-quobyte-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209" acquired by "delete_volume" :: waited 0.033s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c71b97-d7c9-4d72-947b-13801a4f21be]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:42 devstack sudo[100377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209
Sep 06 17:09:42 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:43 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209" returned: 0 in 0.666s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:43 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209
Sep 06 17:09:43 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:43 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209" returned: 0 in 0.522s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209" released by "delete_volume" :: held 1.313s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:43 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created reservations ['3de30d7d-6bbf-47df-b032-58db18a3635e', 'e8195ba2-a7db-45c3-8055-fdef4d107454', '7ea055d7-cdf9-4397-befc-5ad6d167ec35', '26cef2a1-b62c-4d5f-862a-bd9f719bd9dd'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:44 devstack sudo[100386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:44 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:44 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.495s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:44 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Deleted volume successfully.
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44eb4410-e406-4bf8-89bf-eecde74d9d17 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-33c79fe2-1f4a-4b85-b89e-1c0dda0e9209-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:44 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" returned: 0 in 5.156s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:09:44 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Converted 1024.00 MB image at 198.58 MB/s
Sep 06 17:09:44 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99 is being set with open permissions: ugo+rw
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:44 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99
Sep 06 17:09:44 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-quobyte-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ec325e-5db5-412d-9bb4-0c12747e9ad7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:45 devstack sudo[100391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3
Sep 06 17:09:45 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:45 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" returned: 0 in 0.259s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" released by "_copy_volume_from_snapshot" :: held 6.249s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-6738a57e-6896-4075-a7ad-42549c95230a-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" released by "_create_volume_from_snapshot" :: held 6.341s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.375s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596c6da5-7751-4728-b838-e5e431634cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99', 'volume_size': 1, 'snapshot_id': '6738a57e-6896-4075-a7ad-42549c95230a'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce261ccf-5c6d-477d-b205-2607086dab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:45 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Volume volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99 (aee3f86a-67a9-46b4-b3f4-1eb8496c6b99): created successfully
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce261ccf-5c6d-477d-b205-2607086dab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Flow 'volume_create_manager' (1599c53b-66ce-4257-909c-b060d38f3af9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cbcf5069-9e91-4327-9353-6418446e3367 tempest-VolumesDeleteCascade-15191882 None] Created volume successfully.
Sep 06 17:09:45 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3" returned: 0 in 0.468s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:45 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3
Sep 06 17:09:45 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:45 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3" returned: 0 in 0.232s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3" released by "delete_volume" :: held 0.742s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created reservations ['bee51912-7a7c-419d-978a-7c1a7e357962', '87ecfaf9-aa31-4c94-ac37-eb2bdd291429', '8febc876-5f95-4737-818c-96b2a6ad5724', '4dac28ce-94d8-4f94-86b1-849de9315471'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:45 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:45 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-8c8f72d4-27b9-48d3-8034-c8006e36990b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:46 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.302s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:46 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Deleted volume successfully.
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-8c8f72d4-27b9-48d3-8034-c8006e36990b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dc0e4adc-5c3a-44af-bdfc-276ed335e982 tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-2a28fb35-5e2a-41b5-9bec-fb5cd111d7e3-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-69989fbf-0df2-4d21-a25f-b754380eed6c-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-quobyte-8c8f72d4-27b9-48d3-8034-c8006e36990b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-69989fbf-0df2-4d21-a25f-b754380eed6c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-8c8f72d4-27b9-48d3-8034-c8006e36990b" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e823b62b-f130-425b-9a22-990d75564748]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Performing cascade delete. {{(pid=87474) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-6738a57e-6896-4075-a7ad-42549c95230a-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-6738a57e-6896-4075-a7ad-42549c95230a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-69989fbf-0df2-4d21-a25f-b754380eed6c" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:46 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b
Sep 06 17:09:46 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-69989fbf-0df2-4d21-a25f-b754380eed6c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-6738a57e-6896-4075-a7ad-42549c95230a" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-6738a57e-6896-4075-a7ad-42549c95230a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Deleting offline snapshot 6738a57e-6896-4075-a7ad-42549c95230a of volume 69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] snapshot_file for this snap is: volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b1eab1-d4b2-4f84-afa3-1e1b10e25db9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:46 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a
Sep 06 17:09:46 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:46 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b" returned: 0 in 0.408s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:46 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b
Sep 06 17:09:46 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:46 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a" returned: 0 in 0.411s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69989fbf-0df2-4d21-a25f-b754380eed6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7239dbfd-9c9b-4d7f-8304-17baca271636]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:46 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c8f72d4-27b9-48d3-8034-c8006e36990b" returned: 0 in 0.280s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-8c8f72d4-27b9-48d3-8034-c8006e36990b" released by "delete_volume" :: held 0.742s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created reservations ['28880e32-7447-4799-9247-2862f3e18051', '0cc39a41-6d83-4c4d-bdff-79938a4ecf26', '163daafd-78e9-4b70-b3d8-f3ad517a2756', '57d240d8-d727-46b8-8e35-d2c3c31613f8'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:47 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c
Sep 06 17:09:47 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:47 devstack sudo[100419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:47 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-6b6c58eb-5760-421f-8d1d-808df28d6010-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-6b6c58eb-5760-421f-8d1d-808df28d6010-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:47 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-quobyte-6b6c58eb-5760-421f-8d1d-808df28d6010" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:47 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Deleted volume successfully.
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-6b6c58eb-5760-421f-8d1d-808df28d6010" acquired by "delete_volume" :: waited 0.035s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cdbc8797-a702-4bc0-8fb7-8f6989ec8cdc tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-8c8f72d4-27b9-48d3-8034-c8006e36990b-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb65ff-cd17-46ff-a993-f9edada2269f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:47 devstack sudo[100424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010
Sep 06 17:09:47 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:47 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c" returned: 0 in 0.723s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:47 devstack sudo[100427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a
Sep 06 17:09:47 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:47 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010" returned: 0 in 0.411s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:47 devstack sudo[100435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010
Sep 06 17:09:47 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:48 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a" returned: 0 in 0.380s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:48 devstack sudo[100437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a
Sep 06 17:09:48 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:48 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6b6c58eb-5760-421f-8d1d-808df28d6010" returned: 0 in 0.294s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-6b6c58eb-5760-421f-8d1d-808df28d6010" released by "delete_volume" :: held 0.760s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created reservations ['69f0a6b7-c600-4240-ac75-e2a3672e0177', 'e45c42e0-318f-41e9-bbf8-03ce84e0f043', '1fbeeb2d-f14a-47e7-8de7-0f22fc5454c6', 'dfacfc0e-9d01-4943-988b-52d11c490b29'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:48 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c.6738a57e-6896-4075-a7ad-42549c95230a" returned: 0 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-6738a57e-6896-4075-a7ad-42549c95230a" released by "_delete_snapshot" :: held 1.972s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-69989fbf-0df2-4d21-a25f-b754380eed6c" released by "delete_snapshot" :: held 2.003s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:48 devstack sudo[100441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:48 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Created reservations ['a1624b2e-4a01-4ed1-9cd9-54a3b6754df5', 'bff4b86d-cc67-42ff-a22e-3867f6d4de6b', 'd1ffeb65-df41-4707-8e5f-45bcbda60dfd', '0d6fe3a8-1f2b-481a-9e0e-a9e8dc83bc26'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Delete snapshot completed successfully.
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-6738a57e-6896-4075-a7ad-42549c95230a-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Snapshots deleted, issuing volume delete {{(pid=87474) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-69989fbf-0df2-4d21-a25f-b754380eed6c" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "cinder-quobyte-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-69989fbf-0df2-4d21-a25f-b754380eed6c" acquired by "delete_volume" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6" acquired by "delete_volume" :: waited 0.052s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9bc10d-7fae-4e7f-a20c-22f659b4f0f3]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bd2a79-6acc-4e11-b116-e913e9cf1e9a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:48 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.307s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Deleted volume successfully.
Sep 06 17:09:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-dd20ce4c-e9e9-43b0-a5ea-9906af2c4d5f tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-6b6c58eb-5760-421f-8d1d-808df28d6010-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:48 devstack sudo[100444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c
Sep 06 17:09:48 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:48 devstack sudo[100445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6
Sep 06 17:09:48 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:49 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6" returned: 0 in 0.396s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:49 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c" returned: 0 in 0.434s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:49 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6
Sep 06 17:09:49 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:49 devstack sudo[100455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c
Sep 06 17:09:49 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:49 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6" returned: 0 in 0.292s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:49 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-69989fbf-0df2-4d21-a25f-b754380eed6c" returned: 0 in 0.286s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-quobyte-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6" released by "delete_volume" :: held 0.759s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-69989fbf-0df2-4d21-a25f-b754380eed6c" released by "delete_volume" :: held 0.822s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Created reservations ['715260a3-45c8-4c5e-9f93-9eb22fba91ec', '9217594e-82b2-4931-841a-122636291a17', 'a732ab03-4450-4454-b236-54640bfc64ce', 'fd3cdf7a-4b7f-4d70-966c-412b03d8a81c'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Created reservations ['a45d1d91-3bbb-4257-bce8-6a2ba70239ff', '63e8ffdd-d527-4cfa-94de-1e6d629d6458', '94390074-dd6e-4d0e-8383-7462f25cb83d', '1c6a9329-9d4e-44d4-afc6-ea622ecffc5e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:49 devstack sudo[100460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:49 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:49 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:49 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:49 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:49 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Deleted volume successfully.
Sep 06 17:09:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-099496b1-25dd-4ced-8398-4082cdba2fdb tempest-CreateVolumesFromSourceVolumeTest-249344022 None] Lock "cinder-19ec08a7-33ea-4f81-bf49-a61e2c7f31f6-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:49 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.340s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:50 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:50 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Deleted volume successfully.
Sep 06 17:09:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fd9f9eef-c0f5-4d1a-8126-b89a2f34fddf tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-69989fbf-0df2-4d21-a25f-b754380eed6c-delete_volume" released by "delete_volume" :: held 3.814s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "cinder-quobyte-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" acquired by "delete_volume" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:50 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf024cf5-dab3-416d-8515-d43e859ac6b0]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:51 devstack sudo[100466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99
Sep 06 17:09:51 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:51 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" returned: 0 in 0.433s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:51 devstack sudo[100472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99
Sep 06 17:09:51 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:51 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-quobyte-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99" released by "delete_volume" :: held 0.766s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Created reservations ['58fb6cfe-818d-4ae2-9895-5d80f22d8894', 'c18d99a0-b95a-4519-b898-8d28e8593db6', '347751a9-6e17-43fc-8fb6-348a3b832779', 'e73b124c-2e40-4b9f-ba3e-3d5690a19b3a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:51 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:09:51 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:52 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.317s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:52 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:09:52 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Deleted volume successfully.
Sep 06 17:09:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e0f95719-cf49-45d4-a45b-e9736d2ce042 tempest-VolumesDeleteCascade-15191882 None] Lock "cinder-aee3f86a-67a9-46b4-b3f4-1eb8496c6b99-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Flow 'volume_create_manager' (bc35cf91-b447-44c5-8aae-941713581fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757c94aa-bfb3-427e-a1ec-51c87f08bc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757c94aa-bfb3-427e-a1ec-51c87f08bc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-174961903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca42f26-e92d-458f-aa06-438d386ae412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1abf86c14464eda997b55c4e61c2099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:54Z,use_quota=True,user_id='b42a5f9c36ce40748f696c7060a4d756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b729475-3cb2-4aa6-aad9-fd53b885c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b729475-3cb2-4aa6-aad9-fd53b885c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d8bbf8-9240-499f-b670-9ac90d77385f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d8bbf8-9240-499f-b670-9ac90d77385f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca42f26-e92d-458f-aa06-438d386ae412', 'volume_name': 'volume-bca42f26-e92d-458f-aa06-438d386ae412', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4eef8ce-956f-453e-8700-0c7d8e7c7276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4eef8ce-956f-453e-8700-0c7d8e7c7276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a9f49b-37ef-4278-9ab6-6a533b72c6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:53 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Volume bca42f26-e92d-458f-aa06-438d386ae412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca42f26-e92d-458f-aa06-438d386ae412', 'volume_size': 1}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-174961903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca42f26-e92d-458f-aa06-438d386ae412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1abf86c14464eda997b55c4e61c2099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:09:54Z,use_quota=True,user_id='b42a5f9c36ce40748f696c7060a4d756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Creating volume bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:53 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:09:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:53 devstack sudo[100479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 1073741824
Sep 06 17:09:53 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:54 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 1073741824" returned: 0 in 0.547s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:54 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412
Sep 06 17:09:54 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:54 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412" returned: 0 in 0.369s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:09:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a9f49b-37ef-4278-9ab6-6a533b72c6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca42f26-e92d-458f-aa06-438d386ae412', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28128a3-9021-4c81-9284-c334543848f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:54 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Volume volume-bca42f26-e92d-458f-aa06-438d386ae412 (bca42f26-e92d-458f-aa06-438d386ae412): created successfully
Sep 06 17:09:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28128a3-9021-4c81-9284-c334543848f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:54 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Flow 'volume_create_manager' (bc35cf91-b447-44c5-8aae-941713581fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-488d6a8e-801e-4192-8d23-f1700ba5223e tempest-VolumeDependencyTests-1502796835 None] Created volume successfully.
Sep 06 17:09:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Creating offline snapshot 902dc050-b1ec-4671-96ec-0a050e2d2a1b of volume bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:09:55 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e377d264-ded9-4c21-9f73-8be8a0e2f0df]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:09:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:56 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412
Sep 06 17:09:56 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:56 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412" returned: 0 in 0.410s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:56 devstack sudo[100492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b 1G
Sep 06 17:09:56 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:56 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b 1G" returned: 0 in 0.523s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca42f26-e92d-458f-aa06-438d386ae412 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:56 devstack sudo[100498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca42f26-e92d-458f-aa06-438d386ae412 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b
Sep 06 17:09:56 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:57 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca42f26-e92d-458f-aa06-438d386ae412 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b" returned: 0 in 0.392s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:57 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b is being set with open permissions: ugo+rw
Sep 06 17:09:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:57 devstack sudo[100504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b
Sep 06 17:09:57 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:57 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b" returned: 0 in 0.311s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:57 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.info
Sep 06 17:09:57 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:57 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.info" returned: 0 in 0.269s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:57 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.info is being set with open permissions: ugo+rw
Sep 06 17:09:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:09:57 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.info
Sep 06 17:09:57 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:09:58 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Sep 06 17:09:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.info" returned: 0 in 0.306s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:09:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e68c9d04-c8f5-456b-85bf-e23372a9d549 tempest-VolumeDependencyTests-1502796835 None] Create snapshot completed successfully
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Flow 'volume_create_manager' (b2f7e86f-ee21-46cf-b515-b6860f9b37bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04d58d2-260b-47cd-a201-346d0df11f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04d58d2-260b-47cd-a201-346d0df11f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1004881296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1269067d-8f5d-4b15-8f74-86db838dfc3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1abf86c14464eda997b55c4e61c2099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=902dc050-b1ec-4671-96ec-0a050e2d2a1b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:10:00Z,use_quota=True,user_id='b42a5f9c36ce40748f696c7060a4d756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165f2150-403a-4cf5-bbd4-dad0df19c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (165f2150-403a-4cf5-bbd4-dad0df19c85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd51c796-582b-49da-9131-a3687abda564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd51c796-582b-49da-9131-a3687abda564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1269067d-8f5d-4b15-8f74-86db838dfc3b', 'volume_name': 'volume-1269067d-8f5d-4b15-8f74-86db838dfc3b', 'volume_size': 1, 'snapshot_id': '902dc050-b1ec-4671-96ec-0a050e2d2a1b'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40155e8-9d54-4193-8cfe-7836ce801e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40155e8-9d54-4193-8cfe-7836ce801e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d52d9f-9378-4bcf-bb59-2d78ef17389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:09:59 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Volume 1269067d-8f5d-4b15-8f74-86db838dfc3b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1269067d-8f5d-4b15-8f74-86db838dfc3b', 'volume_size': 1, 'snapshot_id': '902dc050-b1ec-4671-96ec-0a050e2d2a1b'}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "cinder-quobyte-902dc050-b1ec-4671-96ec-0a050e2d2a1b-1269067d-8f5d-4b15-8f74-86db838dfc3b" by "_create_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-902dc050-b1ec-4671-96ec-0a050e2d2a1b-1269067d-8f5d-4b15-8f74-86db838dfc3b" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Creating volume 1269067d-8f5d-4b15-8f74-86db838dfc3b from snapshot 902dc050-b1ec-4671-96ec-0a050e2d2a1b {{(pid=87474) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "cinder-quobyte-1269067d-8f5d-4b15-8f74-86db838dfc3b" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-1269067d-8f5d-4b15-8f74-86db838dfc3b" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] snapshot: 902dc050-b1ec-4671-96ec-0a050e2d2a1b, volume: 1269067d-8f5d-4b15-8f74-86db838dfc3b,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:09:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:00 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca8ae0-2738-4028-ac20-a710f6e53be6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:00 devstack sudo[100513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b
Sep 06 17:10:00 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:00 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b" returned: 0 in 0.461s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:00 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca42f26-e92d-458f-aa06-438d386ae412(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:10:00 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c697ce9c-df4c-482b-9cc5-3e34a38131ec]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:00 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412
Sep 06 17:10:00 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:01 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412" returned: 0 in 0.542s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:10:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:10:01 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:10:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:01 devstack sudo[100559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b
Sep 06 17:10:01 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:06 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b" returned: 0 in 5.714s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:06 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:10:06 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Converted 1024.00 MB image at 179.12 MB/s
Sep 06 17:10:06 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b is being set with open permissions: ugo+rw
Sep 06 17:10:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:06 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b
Sep 06 17:10:06 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:07 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b" returned: 0 in 0.267s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-1269067d-8f5d-4b15-8f74-86db838dfc3b" released by "_copy_volume_from_snapshot" :: held 7.088s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-902dc050-b1ec-4671-96ec-0a050e2d2a1b-1269067d-8f5d-4b15-8f74-86db838dfc3b" released by "_create_volume_from_snapshot" :: held 7.168s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.190s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59d52d9f-9378-4bcf-bb59-2d78ef17389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1269067d-8f5d-4b15-8f74-86db838dfc3b', 'volume_size': 1, 'snapshot_id': '902dc050-b1ec-4671-96ec-0a050e2d2a1b'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c91a4f9-faa7-4fcd-850a-7772827c02a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:07 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Volume volume-1269067d-8f5d-4b15-8f74-86db838dfc3b (1269067d-8f5d-4b15-8f74-86db838dfc3b): created successfully
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c91a4f9-faa7-4fcd-850a-7772827c02a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Flow 'volume_create_manager' (b2f7e86f-ee21-46cf-b515-b6860f9b37bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:10:07 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7c41653d-9fdf-4da5-97dc-265360d46e2f tempest-VolumeDependencyTests-1502796835 None] Created volume successfully.
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "cinder-902dc050-b1ec-4671-96ec-0a050e2d2a1b-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-902dc050-b1ec-4671-96ec-0a050e2d2a1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "cinder-quobyte-bca42f26-e92d-458f-aa06-438d386ae412" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-bca42f26-e92d-458f-aa06-438d386ae412" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "cinder-quobyte-902dc050-b1ec-4671-96ec-0a050e2d2a1b" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-902dc050-b1ec-4671-96ec-0a050e2d2a1b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Deleting offline snapshot 902dc050-b1ec-4671-96ec-0a050e2d2a1b of volume bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] snapshot_file for this snap is: volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b21590-5250-42f0-bfa9-cc27091be56d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:07 devstack sudo[100579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b
Sep 06 17:10:07 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:08 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b" returned: 0 in 0.388s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca42f26-e92d-458f-aa06-438d386ae412(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:10:08 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[db95978a-7d13-4f68-a1cd-abca84987467]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:08 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412
Sep 06 17:10:08 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:08 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412" returned: 0 in 0.700s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:08 devstack sudo[100589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b
Sep 06 17:10:08 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:09 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b" returned: 0 in 0.508s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:09 devstack sudo[100595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b
Sep 06 17:10:09 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:09 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412.902dc050-b1ec-4671-96ec-0a050e2d2a1b" returned: 0 in 0.315s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-902dc050-b1ec-4671-96ec-0a050e2d2a1b" released by "_delete_snapshot" :: held 2.088s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-bca42f26-e92d-458f-aa06-438d386ae412" released by "delete_snapshot" :: held 2.115s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:09 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Created reservations ['161eab93-a3b1-47cc-8dc6-a69b90720a75', '4b01bb5b-ea92-47ff-b399-150552f3e7d3', 'ac4fc214-b29f-4fb0-93fc-b083d7a470c8', '689f0af0-5aa0-4809-a2ec-07cba4ee1173'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:10:09 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Delete snapshot completed successfully.
Sep 06 17:10:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8c83c5bd-f528-43a8-92aa-6c43e18b20a8 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-902dc050-b1ec-4671-96ec-0a050e2d2a1b-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "cinder-bca42f26-e92d-458f-aa06-438d386ae412-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-bca42f26-e92d-458f-aa06-438d386ae412-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "cinder-quobyte-bca42f26-e92d-458f-aa06-438d386ae412" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-bca42f26-e92d-458f-aa06-438d386ae412" acquired by "delete_volume" :: waited 0.040s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fc86e2-4e5b-491e-9cc8-39faae9dbca3]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:11 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412
Sep 06 17:10:11 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:11 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412" returned: 0 in 0.444s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:11 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412
Sep 06 17:10:11 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:11 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bca42f26-e92d-458f-aa06-438d386ae412" returned: 0 in 0.305s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-bca42f26-e92d-458f-aa06-438d386ae412" released by "delete_volume" :: held 0.845s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Created reservations ['13a90385-e618-4c3a-811a-5efb16cf4e8e', '2b142287-69fd-4179-88b1-71396706b6d6', 'b8a7c404-5539-45a4-9459-6a1ffe66c675', '8f1aeabe-6996-4086-a789-0f405d8e957d'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:12 devstack sudo[100609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:10:12 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "cinder-1269067d-8f5d-4b15-8f74-86db838dfc3b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-1269067d-8f5d-4b15-8f74-86db838dfc3b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "cinder-quobyte-1269067d-8f5d-4b15-8f74-86db838dfc3b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-1269067d-8f5d-4b15-8f74-86db838dfc3b" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e0a0a3-f7c6-40f4-b7cb-423298681ac3]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:12 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.402s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:10:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Deleted volume successfully.
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b289ee1-1d59-466b-8a89-1bba6f383584 tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-bca42f26-e92d-458f-aa06-438d386ae412-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:12 devstack sudo[100612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b
Sep 06 17:10:12 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:12 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b" returned: 0 in 0.479s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:12 devstack sudo[100617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b
Sep 06 17:10:12 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:13 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1269067d-8f5d-4b15-8f74-86db838dfc3b" returned: 0 in 0.324s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-quobyte-1269067d-8f5d-4b15-8f74-86db838dfc3b" released by "delete_volume" :: held 0.870s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Created reservations ['bd769a9c-5ac6-4ab8-9cd6-a1dd5ef894a1', '45945148-c191-438f-9272-d2b677847a5b', '070d2243-c90d-4518-add9-f17df581c080', 'b4fbcbe4-2876-445e-96a3-387faf712956'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:13 devstack sudo[100620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:10:13 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:13 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.412s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:10:13 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Deleted volume successfully.
Sep 06 17:10:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1677637-f0cc-479a-9ab1-d43b593cd6fb tempest-VolumeDependencyTests-1502796835 None] Lock "cinder-1269067d-8f5d-4b15-8f74-86db838dfc3b-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Flow 'volume_create_manager' (f695abef-846b-402c-a8c0-04b9e5fe3639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28f71fe-832a-45af-8644-fa72b0fee30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e28f71fe-832a-45af-8644-fa72b0fee30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1206763722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9430dd5a-b848-4a18-8496-8bdf2f17745b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e4084e5db484d9aa6a17dbec0854516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:10:16Z,use_quota=True,user_id='f819918c467244789caab45faf0ccbd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd19ad9e-06ec-43a8-b0bf-7dd632ceccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd19ad9e-06ec-43a8-b0bf-7dd632ceccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c28f5fe-8ab5-4e97-baae-e6e5a699c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c28f5fe-8ab5-4e97-baae-e6e5a699c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9430dd5a-b848-4a18-8496-8bdf2f17745b', 'volume_name': 'volume-9430dd5a-b848-4a18-8496-8bdf2f17745b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6423915f-f100-484f-93b0-6fc6f741534e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6423915f-f100-484f-93b0-6fc6f741534e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330c795d-5b23-4987-842f-1d8cc72c4493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:15 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Volume 9430dd5a-b848-4a18-8496-8bdf2f17745b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9430dd5a-b848-4a18-8496-8bdf2f17745b', 'volume_size': 1}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1206763722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9430dd5a-b848-4a18-8496-8bdf2f17745b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e4084e5db484d9aa6a17dbec0854516',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:10:16Z,use_quota=True,user_id='f819918c467244789caab45faf0ccbd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Creating volume 9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:10:15 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:10:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:15 devstack sudo[100624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b 1073741824
Sep 06 17:10:15 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:16 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b 1073741824" returned: 0 in 0.640s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:16 devstack sudo[100630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b
Sep 06 17:10:16 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:16 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b" returned: 0 in 0.389s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:10:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (330c795d-5b23-4987-842f-1d8cc72c4493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9430dd5a-b848-4a18-8496-8bdf2f17745b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6edf69-a3cd-4103-9f98-566121d25eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:16 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Volume volume-9430dd5a-b848-4a18-8496-8bdf2f17745b (9430dd5a-b848-4a18-8496-8bdf2f17745b): created successfully
Sep 06 17:10:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6edf69-a3cd-4103-9f98-566121d25eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Flow 'volume_create_manager' (f695abef-846b-402c-a8c0-04b9e5fe3639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:10:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c9cef356-83ea-4cf6-83ff-6c2f0148f233 tempest-VolumesActionsTest-1723562150 None] Created volume successfully.
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Flow 'volume_create_manager' (34e6ff84-cafb-4e5f-a09f-4d6231b55405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d9d7a2-04ad-495a-a738-4bd8e27e382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d9d7a2-04ad-495a-a738-4bd8e27e382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5587c065-ddb0-4f7e-98d9-3f2e136f9e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae1e2d3dad944f8907030a07d362326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:10:18Z,use_quota=True,user_id='c36287dc28554972b746d8eac7378947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a582d95-9bf9-4655-aa01-91933ede9caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a582d95-9bf9-4655-aa01-91933ede9caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8a2462-0352-4c56-a6c3-9b768f24e7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8a2462-0352-4c56-a6c3-9b768f24e7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5587c065-ddb0-4f7e-98d9-3f2e136f9e74', 'volume_name': 'volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40734fe5-305d-4f8e-a90e-c615b04738a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40734fe5-305d-4f8e-a90e-c615b04738a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956f1984-c828-44e2-bf5b-c48a4c43eb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:18 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Volume 5587c065-ddb0-4f7e-98d9-3f2e136f9e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74', 'volume_size': 1}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5587c065-ddb0-4f7e-98d9-3f2e136f9e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae1e2d3dad944f8907030a07d362326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:10:18Z,use_quota=True,user_id='c36287dc28554972b746d8eac7378947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Creating volume 5587c065-ddb0-4f7e-98d9-3f2e136f9e74 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:10:18 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:18 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74 1073741824
Sep 06 17:10:18 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:18 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74 1073741824" returned: 0 in 0.518s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:18 devstack sudo[100649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74
Sep 06 17:10:18 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:19 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74" returned: 0 in 0.342s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:10:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956f1984-c828-44e2-bf5b-c48a4c43eb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1888c3bd-2295-431a-acc1-fbdfae9c576a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:19 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Volume volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74 (5587c065-ddb0-4f7e-98d9-3f2e136f9e74): created successfully
Sep 06 17:10:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1888c3bd-2295-431a-acc1-fbdfae9c576a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Flow 'volume_create_manager' (34e6ff84-cafb-4e5f-a09f-4d6231b55405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:10:19 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-61aad62f-f6a0-4789-8d4e-87f9b87af426 tempest-CinderUnicodeTest-856860739 None] Created volume successfully.
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Flow 'volume_create_manager' (2c029302-c8bd-49b5-9692-dca765077977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d14285a-e926-42e4-beaa-b7e2a9a900b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d14285a-e926-42e4-beaa-b7e2a9a900b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1464335290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef93cde820264ede98ef5a23c32507af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:10:21Z,use_quota=True,user_id='ef46ae725a4041338a54d18c949ae213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e0ecec-8241-4075-b879-a3792c7e84d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e0ecec-8241-4075-b879-a3792c7e84d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a7cc52-126a-4034-a976-9a31b8ab544e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a7cc52-126a-4034-a976-9a31b8ab544e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503', 'volume_name': 'volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ee36c-7300-4efa-aad3-3586f1e8c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70ee36c-7300-4efa-aad3-3586f1e8c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a721d6d-dded-403f-965d-3c76e258ee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Volume bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503', 'volume_size': 1}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1464335290',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef93cde820264ede98ef5a23c32507af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:10:21Z,use_quota=True,user_id='ef46ae725a4041338a54d18c949ae213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Creating volume bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:10:20 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:10:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:20 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 1073741824
Sep 06 17:10:20 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Flow 'volume_create_manager' (cb1b655c-0065-486b-a104-8157f40cc56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cf46b9-93db-403a-b9d2-b6a91a2974a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11cf46b9-93db-403a-b9d2-b6a91a2974a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:10:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-631000628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dffc8c-5fc7-4867-b1a5-7e50070aa182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae1e2d3dad944f8907030a07d362326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:10:21Z,use_quota=True,user_id='c36287dc28554972b746d8eac7378947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f26825-513e-4909-8183-7eb2d339e138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f26825-513e-4909-8183-7eb2d339e138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c9fa59-0ad5-4f36-805c-0dd05e2eef5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c9fa59-0ad5-4f36-805c-0dd05e2eef5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2dffc8c-5fc7-4867-b1a5-7e50070aa182', 'volume_name': 'volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43309455-9e84-4aa3-b74f-c7c41ecf3967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43309455-9e84-4aa3-b74f-c7c41ecf3967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d5b800-4ba7-4dc6-b27d-205d5558dfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:21 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Volume e2dffc8c-5fc7-4867-b1a5-7e50070aa182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182', 'volume_size': 1}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:21 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 1073741824" returned: 0 in 0.851s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:21 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503
Sep 06 17:10:21 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:22 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" returned: 0 in 0.300s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.547s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:10:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-631000628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dffc8c-5fc7-4867-b1a5-7e50070aa182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ae1e2d3dad944f8907030a07d362326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:10:21Z,use_quota=True,user_id='c36287dc28554972b746d8eac7378947',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Creating volume e2dffc8c-5fc7-4867-b1a5-7e50070aa182 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:10:22 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a721d6d-dded-403f-965d-3c76e258ee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de2d593-9bdf-4f44-b3b3-d9a4d77f164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:22 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 1073741824
Sep 06 17:10:22 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:22 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Volume volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 (bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503): created successfully
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de2d593-9bdf-4f44-b3b3-d9a4d77f164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Flow 'volume_create_manager' (2c029302-c8bd-49b5-9692-dca765077977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:10:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1c3b2602-8f27-4d3f-86f6-a2771269dbe7 tempest-TestStampPattern-904558217 None] Created volume successfully.
Sep 06 17:10:22 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 1073741824" returned: 0 in 0.661s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=135,cinder:SELECT=102,cinder:INSERT=32,cinder:DELETE=14 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=102,cinder:UPDATE=148,cinder:DELETE=12,cinder:INSERT=35 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:10:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:22 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182
Sep 06 17:10:22 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:23 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" returned: 0 in 0.362s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d5b800-4ba7-4dc6-b27d-205d5558dfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c2686b-500d-48a4-8a7c-e68613888af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:10:23 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Volume volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 (e2dffc8c-5fc7-4867-b1a5-7e50070aa182): created successfully
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c2686b-500d-48a4-8a7c-e68613888af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Flow 'volume_create_manager' (cb1b655c-0065-486b-a104-8157f40cc56d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:10:23 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3bce2afb-1301-486e-bb7d-f6380050c374 tempest-CinderUnicodeTest-856860739 None] Created volume successfully.
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Creating offline snapshot 9dbfe744-153d-4196-b91d-0d4d4333bb2a of volume e2dffc8c-5fc7-4867-b1a5-7e50070aa182 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d7b3e9-e7f0-44ad-b65a-b27330ca019e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:24 devstack sudo[100718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182
Sep 06 17:10:24 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:24 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" returned: 0 in 0.673s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:24 devstack sudo[100762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a 1G
Sep 06 17:10:24 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:25 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a 1G" returned: 0 in 0.868s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:25 devstack sudo[100787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a
Sep 06 17:10:25 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:26 devstack sudo[100795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:10:26 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:26 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a" returned: 0 in 0.713s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:26 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a is being set with open permissions: ugo+rw
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:26 devstack sudo[100797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a
Sep 06 17:10:26 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:26 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a" returned: 0 in 0.443s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:26 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.521s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:26 devstack sudo[100803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.info
Sep 06 17:10:26 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-05b490d1-0e70-4b2b-9086-7843f374b91d tempest-VolumesActionsTest-1723562150 None] Acquiring lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b" by "attach_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-05b490d1-0e70-4b2b-9086-7843f374b91d tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b" acquired by "attach_volume" :: waited 0.047s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:27 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.info" returned: 0 in 0.379s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:27 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.info is being set with open permissions: ugo+rw
Sep 06 17:10:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-05b490d1-0e70-4b2b-9086-7843f374b91d tempest-VolumesActionsTest-1723562150 None] Attaching volume 9430dd5a-b848-4a18-8496-8bdf2f17745b to instance f402c6e4-8346-45d1-a9b3-7bb153ce7e24 at mountpoint /dev/vdb on host None.
Sep 06 17:10:27 devstack sudo[100806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.info
Sep 06 17:10:27 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-05b490d1-0e70-4b2b-9086-7843f374b91d tempest-VolumesActionsTest-1723562150 None] Attach volume completed successfully.
Sep 06 17:10:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-05b490d1-0e70-4b2b-9086-7843f374b91d tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b" released by "attach_volume" :: held 0.154s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-13bd34aa-ecda-439c-a5d5-94e7ed89ec59 tempest-VolumesActionsTest-1723562150 None] Acquiring lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b-detach_volume" by "detach_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-13bd34aa-ecda-439c-a5d5-94e7ed89ec59 tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-13bd34aa-ecda-439c-a5d5-94e7ed89ec59 tempest-VolumesActionsTest-1723562150 None] Detaching volume 9430dd5a-b848-4a18-8496-8bdf2f17745b from instance f402c6e4-8346-45d1-a9b3-7bb153ce7e24.
Sep 06 17:10:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-13bd34aa-ecda-439c-a5d5-94e7ed89ec59 tempest-VolumesActionsTest-1723562150 None] Detach volume completed successfully.
Sep 06 17:10:27 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.info" returned: 0 in 0.436s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.703s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-13bd34aa-ecda-439c-a5d5-94e7ed89ec59 tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-2940261b-2ae9-4746-90db-d4ccab0ce10e tempest-CinderUnicodeTest-856860739 None] Create snapshot completed successfully
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Acquiring lock "cinder-9dbfe744-153d-4196-b91d-0d4d4333bb2a-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Lock "cinder-9dbfe744-153d-4196-b91d-0d4d4333bb2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Acquiring lock "cinder-quobyte-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Lock "cinder-quobyte-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Acquiring lock "cinder-quobyte-9dbfe744-153d-4196-b91d-0d4d4333bb2a" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Lock "cinder-quobyte-9dbfe744-153d-4196-b91d-0d4d4333bb2a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Deleting offline snapshot 9dbfe744-153d-4196-b91d-0d4d4333bb2a of volume e2dffc8c-5fc7-4867-b1a5-7e50070aa182 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] snapshot_file for this snap is: volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfdd982-989c-4bf5-8bb4-9f290175922a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:28 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a
Sep 06 17:10:28 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:29 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a" returned: 0 in 0.626s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:10:29 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee9ccce-9d80-4e44-be1a-d3844586f078]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:29 devstack sudo[100869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182
Sep 06 17:10:29 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:30 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" returned: 0 in 0.932s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:30 devstack sudo[100905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a
Sep 06 17:10:30 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:30 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a" returned: 0 in 0.735s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:30 devstack sudo[100914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a
Sep 06 17:10:30 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:31 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182.9dbfe744-153d-4196-b91d-0d4d4333bb2a" returned: 0 in 0.424s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Lock "cinder-quobyte-9dbfe744-153d-4196-b91d-0d4d4333bb2a" released by "_delete_snapshot" :: held 2.968s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Lock "cinder-quobyte-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" released by "delete_snapshot" :: held 3.007s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:31 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Created reservations ['05f838e4-b071-4408-b0dd-d0bb4bb64976', '29cbad70-663e-4723-be29-ab34a109e3af', '57e490f0-f147-4457-b6e8-9c0b94fa3e57', 'd56aa221-e385-480f-b016-7639a82782b8'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:10:31 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Delete snapshot completed successfully.
Sep 06 17:10:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f34043e4-09ed-419b-ac62-74fe66ec81cc tempest-CinderUnicodeTest-856860739 None] Lock "cinder-9dbfe744-153d-4196-b91d-0d4d4333bb2a-delete_snapshot" released by "delete_snapshot" :: held 3.404s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Acquiring lock "cinder-e2dffc8c-5fc7-4867-b1a5-7e50070aa182-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Lock "cinder-e2dffc8c-5fc7-4867-b1a5-7e50070aa182-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Acquiring lock "cinder-quobyte-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Lock "cinder-quobyte-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:32 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[13acb92e-29cb-4da3-ac03-a195aadb7984]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:32 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182
Sep 06 17:10:32 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:33 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" returned: 0 in 0.563s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:33 devstack sudo[100931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182
Sep 06 17:10:33 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:33 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" returned: 0 in 0.294s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Lock "cinder-quobyte-e2dffc8c-5fc7-4867-b1a5-7e50070aa182" released by "delete_volume" :: held 0.963s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Created reservations ['f71e1c05-787d-4573-a56f-3437e526daa0', 'c799751c-5a21-42b2-b686-410aa6582d9f', 'ded62b6a-a6fe-47a2-9c0e-dbd9199f76ad', 'aba773dd-f158-4bfd-9cee-4644553e0e2f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:33 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:10:33 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Acquiring lock "cinder-5587c065-ddb0-4f7e-98d9-3f2e136f9e74-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Lock "cinder-5587c065-ddb0-4f7e-98d9-3f2e136f9e74-delete_volume" acquired by "delete_volume" :: waited 0.259s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Acquiring lock "cinder-quobyte-5587c065-ddb0-4f7e-98d9-3f2e136f9e74" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Lock "cinder-quobyte-5587c065-ddb0-4f7e-98d9-3f2e136f9e74" acquired by "delete_volume" :: waited 0.061s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:34 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d7d564-a71c-4c9f-8963-f7447c74f894]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:34 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.834s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:34 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:10:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Deleted volume successfully.
Sep 06 17:10:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-0e8417af-ed97-48e2-ba82-30582b4bacf9 tempest-CinderUnicodeTest-856860739 None] Lock "cinder-e2dffc8c-5fc7-4867-b1a5-7e50070aa182-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:34 devstack sudo[100940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74
Sep 06 17:10:34 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:35 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74" returned: 0 in 0.634s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:35 devstack sudo[100947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74
Sep 06 17:10:35 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:35 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-5587c065-ddb0-4f7e-98d9-3f2e136f9e74" returned: 0 in 0.455s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Lock "cinder-quobyte-5587c065-ddb0-4f7e-98d9-3f2e136f9e74" released by "delete_volume" :: held 1.178s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Created reservations ['8fb22787-6bf5-40e5-9473-7af84153c6e9', '56f597b5-d895-4ae1-913c-5dc65e70cab5', 'd921193a-fa57-4adb-a559-9579eebe9baa', '0544c5a4-8a41-4057-9f8e-21ec7956c5e7'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:10:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:35 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:10:35 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:36 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.395s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:36 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:10:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Deleted volume successfully.
Sep 06 17:10:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-df9ac182-eca2-44fd-9e4a-33039f60861f tempest-CinderUnicodeTest-856860739 None] Lock "cinder-5587c065-ddb0-4f7e-98d9-3f2e136f9e74-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5916cfb7-e46d-4d7e-9681-1ceecd1a091c tempest-VolumesActionsTest-1723562150 None] Acquiring lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b" by "attach_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5916cfb7-e46d-4d7e-9681-1ceecd1a091c tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b" acquired by "attach_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5916cfb7-e46d-4d7e-9681-1ceecd1a091c tempest-VolumesActionsTest-1723562150 None] Attaching volume 9430dd5a-b848-4a18-8496-8bdf2f17745b to instance 2fac489a-d0b2-4dd0-b582-05a63b97febe at mountpoint /dev/vdb on host None.
Sep 06 17:10:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5916cfb7-e46d-4d7e-9681-1ceecd1a091c tempest-VolumesActionsTest-1723562150 None] Attach volume completed successfully.
Sep 06 17:10:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5916cfb7-e46d-4d7e-9681-1ceecd1a091c tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b" released by "attach_volume" :: held 0.097s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9e281d9d-f812-4393-91e2-4fb9b17995c7 tempest-VolumesActionsTest-1723562150 None] Acquiring lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b-detach_volume" by "detach_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:10:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9e281d9d-f812-4393-91e2-4fb9b17995c7 tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:10:42 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9e281d9d-f812-4393-91e2-4fb9b17995c7 tempest-VolumesActionsTest-1723562150 None] Detaching volume 9430dd5a-b848-4a18-8496-8bdf2f17745b from instance 2fac489a-d0b2-4dd0-b582-05a63b97febe.
Sep 06 17:10:42 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9e281d9d-f812-4393-91e2-4fb9b17995c7 tempest-VolumesActionsTest-1723562150 None] Detach volume completed successfully.
Sep 06 17:10:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9e281d9d-f812-4393-91e2-4fb9b17995c7 tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:10:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:10:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:10:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3285c-4ab9-404c-8980-64cb1004ac0c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:46 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b
Sep 06 17:10:46 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:46 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b" returned: 0 in 0.345s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b53b63-660b-4c08-be34-70d27d205018]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:46 devstack sudo[101085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b
Sep 06 17:10:46 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:47 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.df87f35b-4da8-41c7-b589-b20d3e85e0461wo6slft.img {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:47 devstack sudo[101090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.df87f35b-4da8-41c7-b589-b20d3e85e0461wo6slft.img
Sep 06 17:10:47 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:51 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.df87f35b-4da8-41c7-b589-b20d3e85e0461wo6slft.img" returned: 0 in 4.198s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a174e4bc-a260-435a-9017-779097ed3251]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:10:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:10:51 devstack sudo[101103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b
Sep 06 17:10:51 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:10:51 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root
Sep 06 17:10:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b" returned: 0 in 0.521s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:10:51 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b, size 1024.00 MB, duration 4.20 sec, destination /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.df87f35b-4da8-41c7-b589-b20d3e85e0461wo6slft.img {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:10:51 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Converted 1024.00 MB image at 243.85 MB/s
Sep 06 17:10:51 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] df87f35b-4da8-41c7-b589-b20d3e85e046 was raw, no need to convert to raw {{(pid=87474) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 06 17:10:52 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=32,cinder:SELECT=26,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:10:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-a8c49232-7981-45d1-96bc-e6b2c9e6096d req-26bcfd56-821e-4e49-a38e-e0dad9eadc84 tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:05 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:11:05 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=43,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:11:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.182s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Uploaded volume to glance image-id: df87f35b-4da8-41c7-b589-b20d3e85e046. {{(pid=87474) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 06 17:11:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-a8c49232-7981-45d1-96bc-e6b2c9e6096d req-26bcfd56-821e-4e49-a38e-e0dad9eadc84 tempest-TestStampPattern-904558217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.038s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-a8c49232-7981-45d1-96bc-e6b2c9e6096d req-26bcfd56-821e-4e49-a38e-e0dad9eadc84 tempest-TestStampPattern-904558217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:10 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1592d773-d533-44c6-b653-7c1f3c4d8388 tempest-VolumesActionsTest-1723562150 None] Copy volume to image completed successfully.
Sep 06 17:11:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-a8c49232-7981-45d1-96bc-e6b2c9e6096d req-26bcfd56-821e-4e49-a38e-e0dad9eadc84 tempest-TestStampPattern-904558217 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31a1de42-451c-4ed0-9507-7b35b1b6321f', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:11:10 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-a8c49232-7981-45d1-96bc-e6b2c9e6096d req-26bcfd56-821e-4e49-a38e-e0dad9eadc84 tempest-TestStampPattern-904558217 None] attachment_update completed successfully.
Sep 06 17:11:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:12 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcb2425-0e59-47d4-bef0-f24fbfd6863a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:12 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b
Sep 06 17:11:12 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:12 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b" returned: 0 in 0.372s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:12 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9951d-534e-44d3-96d4-ee8a6c28e198]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:12 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b
Sep 06 17:11:12 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:12 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b" returned: 0 in 0.346s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:12 devstack sudo[101567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img
Sep 06 17:11:12 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-87f2aed5-6e7d-44d9-8200-b970643ca965 req-eae84211-1737-4f8f-9515-affb18167a35 tempest-TestStampPattern-904558217 None] Terminate volume connection completed successfully.
Sep 06 17:11:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-87f2aed5-6e7d-44d9-8200-b970643ca965 req-eae84211-1737-4f8f-9515-affb18167a35 tempest-TestStampPattern-904558217 None] Deleting attachment 31a1de42-451c-4ed0-9507-7b35b1b6321f. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:11:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:17 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img" returned: 0 in 4.239s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:17 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c49225a-85f5-49fc-a880-8eec6be8fc32]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:17 devstack sudo[101619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b
Sep 06 17:11:17 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:17 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b" returned: 0 in 0.519s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:17 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:11:17 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Converted 1024.00 MB image at 241.51 MB/s
Sep 06 17:11:17 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] 12678ff2-d981-40f8-b60b-2a945d02e066 was raw, converting to qcow2 {{(pid=87474) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Sep 06 17:11:17 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[384e086b-71fc-4e6c-b416-1d54a4a6cc81]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:17 devstack sudo[101624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img
Sep 06 17:11:17 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:18 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img" returned: 0 in 0.339s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:18 devstack sudo[101628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img
Sep 06 17:11:18 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:18 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img" returned: 1 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img /opt/stack/data/cinder/conversion/vol_upload_h6c6hcg_ {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:18 devstack sudo[101633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img /opt/stack/data/cinder/conversion/vol_upload_h6c6hcg_
Sep 06 17:11:18 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:18 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img /opt/stack/data/cinder/conversion/vol_upload_h6c6hcg_" returned: 0 in 0.245s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Image conversion details: src /opt/stack/data/cinder/conversion/9430dd5a-b848-4a18-8496-8bdf2f17745b.temp_image.12678ff2-d981-40f8-b60b-2a945d02e0661znu4kdh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_h6c6hcg_ {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:11:18 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2557784-1000-4b41-9d0d-3300bb93eb12]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h6c6hcg_ {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:18 devstack sudo[101641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h6c6hcg_
Sep 06 17:11:18 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:18 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h6c6hcg_" returned: 0 in 0.328s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.148s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Uploaded volume to glance image-id: 12678ff2-d981-40f8-b60b-2a945d02e066. {{(pid=87474) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 06 17:11:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.968s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Creating offline snapshot feb288f3-81ca-48a5-850b-278b96962d64 of volume bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:11:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-71123893-071e-4034-b7cb-b277ae39f7cb tempest-VolumesActionsTest-1723562150 None] Copy volume to image completed successfully.
Sep 06 17:11:20 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ea764b-28ea-4b5f-b6a4-30141796a221]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:20 devstack sudo[101649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503
Sep 06 17:11:20 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:20 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" returned: 0 in 0.386s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:20 devstack sudo[101654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 1G
Sep 06 17:11:20 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:21 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 1G" returned: 0 in 0.444s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Acquiring lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:21 devstack sudo[101659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64
Sep 06 17:11:21 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Acquiring lock "cinder-quobyte-9430dd5a-b848-4a18-8496-8bdf2f17745b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Lock "cinder-quobyte-9430dd5a-b848-4a18-8496-8bdf2f17745b" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3822a4f-2d0d-41cb-857f-fdd82a50e96c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:21 devstack sudo[101661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b
Sep 06 17:11:21 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:21 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64" returned: 0 in 0.326s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:21 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 is being set with open permissions: ugo+rw
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:21 devstack sudo[101666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64
Sep 06 17:11:21 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:21 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b" returned: 0 in 0.381s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:21 devstack sudo[101672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b
Sep 06 17:11:21 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:21 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64" returned: 0 in 0.239s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:21 devstack sudo[101675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.info
Sep 06 17:11:21 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:21 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9430dd5a-b848-4a18-8496-8bdf2f17745b" returned: 0 in 0.255s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Lock "cinder-quobyte-9430dd5a-b848-4a18-8496-8bdf2f17745b" released by "delete_volume" :: held 0.677s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Created reservations ['fe5730a7-8a42-4734-b886-74616e6de691', '3fda1587-9912-41d6-8716-b89e48778437', '7dd96131-b2ca-4efb-9c8a-b354228e5618', '9629e927-3ab0-4233-a2c0-6add6f55656e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:11:22 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.info" returned: 0 in 0.257s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:22 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.info is being set with open permissions: ugo+rw
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:22 devstack sudo[101679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.info
Sep 06 17:11:22 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:22 devstack sudo[101681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:11:22 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:22 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.info" returned: 0 in 0.251s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-590db679-8142-4076-9def-a300dfe79b72 tempest-TestStampPattern-904558217 None] Create snapshot completed successfully
Sep 06 17:11:22 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.285s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:11:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Deleted volume successfully.
Sep 06 17:11:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e8f892c1-685e-4d6f-a670-ce10378f13e2 tempest-VolumesActionsTest-1723562150 None] Lock "cinder-9430dd5a-b848-4a18-8496-8bdf2f17745b-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:26 devstack sudo[101725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:11:26 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:26 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.270s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:11:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Flow 'volume_create_manager' (706985bc-c34a-4c8e-a26e-45b690c157ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc38eca-2a1e-4cbd-91a0-8bf7bfb2683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc38eca-2a1e-4cbd-91a0-8bf7bfb2683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1813080138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77992d1-44a4-4283-a6d4-b162075e7789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef93cde820264ede98ef5a23c32507af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=feb288f3-81ca-48a5-850b-278b96962d64,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:11:29Z,use_quota=True,user_id='ef46ae725a4041338a54d18c949ae213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6954eec5-e4d8-4891-a21f-7e16e5c8b313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6954eec5-e4d8-4891-a21f-7e16e5c8b313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3565664-2fc2-4808-9d21-e05f8c794dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3565664-2fc2-4808-9d21-e05f8c794dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b77992d1-44a4-4283-a6d4-b162075e7789', 'volume_name': 'volume-b77992d1-44a4-4283-a6d4-b162075e7789', 'volume_size': 1, 'snapshot_id': 'feb288f3-81ca-48a5-850b-278b96962d64'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b3c736-2834-4ab8-b8ae-85b2ce86cff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b3c736-2834-4ab8-b8ae-85b2ce86cff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a22e16-d4db-4487-9169-215cd59a8fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:29 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Volume b77992d1-44a4-4283-a6d4-b162075e7789: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b77992d1-44a4-4283-a6d4-b162075e7789', 'volume_size': 1, 'snapshot_id': 'feb288f3-81ca-48a5-850b-278b96962d64'}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Acquiring lock "cinder-quobyte-feb288f3-81ca-48a5-850b-278b96962d64-b77992d1-44a4-4283-a6d4-b162075e7789" by "_create_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-feb288f3-81ca-48a5-850b-278b96962d64-b77992d1-44a4-4283-a6d4-b162075e7789" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Creating volume b77992d1-44a4-4283-a6d4-b162075e7789 from snapshot feb288f3-81ca-48a5-850b-278b96962d64 {{(pid=87474) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Acquiring lock "cinder-quobyte-b77992d1-44a4-4283-a6d4-b162075e7789" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-b77992d1-44a4-4283-a6d4-b162075e7789" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] snapshot: feb288f3-81ca-48a5-850b-278b96962d64, volume: b77992d1-44a4-4283-a6d4-b162075e7789,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce80c3-0eac-4c63-987e-7ce79c33d8b1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:29 devstack sudo[101731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64
Sep 06 17:11:29 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:29 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64" returned: 0 in 0.378s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b72d6-659a-42dd-b7c0-5b3ddee35816]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:30 devstack sudo[101736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503
Sep 06 17:11:30 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Flow 'volume_create_manager' (91651f3b-5ac2-425b-b1ce-f8710fdf87f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac34227-5fed-465b-85cc-3f06865e7959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:30 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" returned: 0 in 0.477s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789 not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:30 devstack sudo[101744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789
Sep 06 17:11:30 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac34227-5fed-465b-85cc-3f06865e7959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1316427071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b75ce5-68ac-485f-92e8-5a8d20603d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8c35fa0f3d4c9fa24a2125ca81366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:11:30Z,use_quota=True,user_id='709009a831c34e50af8828adf16572e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dea57c5-da86-498e-a13f-2d3503056830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dea57c5-da86-498e-a13f-2d3503056830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc0857d-3347-4683-a074-b42d06989b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc0857d-3347-4683-a074-b42d06989b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b75ce5-68ac-485f-92e8-5a8d20603d09', 'volume_name': 'volume-50b75ce5-68ac-485f-92e8-5a8d20603d09', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c452f5f1-d67e-4734-8d63-59c5163f7784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c452f5f1-d67e-4734-8d63-59c5163f7784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c35b051-de3a-4c68-b4f6-b19ea8acf0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:30 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Volume 50b75ce5-68ac-485f-92e8-5a8d20603d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b75ce5-68ac-485f-92e8-5a8d20603d09', 'volume_size': 1}
Sep 06 17:11:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:36 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789" returned: 0 in 5.638s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:11:36 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Converted 1024.00 MB image at 181.55 MB/s
Sep 06 17:11:36 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789 is being set with open permissions: ugo+rw
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:36 devstack sudo[101768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789
Sep 06 17:11:36 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:36 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789" returned: 0 in 0.315s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-b77992d1-44a4-4283-a6d4-b162075e7789" released by "_copy_volume_from_snapshot" :: held 6.903s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-feb288f3-81ca-48a5-850b-278b96962d64-b77992d1-44a4-4283-a6d4-b162075e7789" released by "_create_volume_from_snapshot" :: held 6.983s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.950s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1316427071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b75ce5-68ac-485f-92e8-5a8d20603d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8c35fa0f3d4c9fa24a2125ca81366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:11:30Z,use_quota=True,user_id='709009a831c34e50af8828adf16572e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Creating volume 50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:11:36 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:36 devstack sudo[101772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 1073741824
Sep 06 17:11:36 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a22e16-d4db-4487-9169-215cd59a8fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77992d1-44a4-4283-a6d4-b162075e7789', 'volume_size': 1, 'snapshot_id': 'feb288f3-81ca-48a5-850b-278b96962d64'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e86c8f-c2b8-441f-90f4-ce5b234be14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:36 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Volume volume-b77992d1-44a4-4283-a6d4-b162075e7789 (b77992d1-44a4-4283-a6d4-b162075e7789): created successfully
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e86c8f-c2b8-441f-90f4-ce5b234be14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Flow 'volume_create_manager' (706985bc-c34a-4c8e-a26e-45b690c157ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:11:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d4468ca7-6fe2-41e2-9ed5-d3936774ba9a tempest-TestStampPattern-904558217 None] Created volume successfully.
Sep 06 17:11:37 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 1073741824" returned: 0 in 0.516s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:37 devstack sudo[101792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09
Sep 06 17:11:37 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:37 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09" returned: 0 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:11:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c35b051-de3a-4c68-b4f6-b19ea8acf0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b75ce5-68ac-485f-92e8-5a8d20603d09', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e7c00a-97ae-479a-90d5-ddefa6b218ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:37 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Volume volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 (50b75ce5-68ac-485f-92e8-5a8d20603d09): created successfully
Sep 06 17:11:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e7c00a-97ae-479a-90d5-ddefa6b218ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Flow 'volume_create_manager' (91651f3b-5ac2-425b-b1ce-f8710fdf87f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:11:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-360c1107-4afa-4577-a933-b4e071b2030a tempest-VolumesCloneTest-352469998 None] Created volume successfully.
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Flow 'volume_create_manager' (d932086a-3b0c-459a-9630-f216239f5ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16011ad-473a-4229-a978-036f69bef514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16011ad-473a-4229-a978-036f69bef514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1332406046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939c30ff-8b15-4825-abb5-6d229d89404e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b8c35fa0f3d4c9fa24a2125ca81366e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:11:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=50b75ce5-68ac-485f-92e8-5a8d20603d09,status='creating',terminated_at=None,updated_at=2026-09-06T15:11:39Z,use_quota=True,user_id='709009a831c34e50af8828adf16572e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b981f4d-6d1f-4ef4-bdac-615d4753bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b981f4d-6d1f-4ef4-bdac-615d4753bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2f943c-a51d-474c-93cc-61762bc4956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f2f943c-a51d-474c-93cc-61762bc4956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '939c30ff-8b15-4825-abb5-6d229d89404e', 'volume_name': 'volume-939c30ff-8b15-4825-abb5-6d229d89404e', 'volume_size': 2, 'source_volid': '50b75ce5-68ac-485f-92e8-5a8d20603d09', 'source_volstatus': 'available'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d96847-a2e1-4d01-82cd-3d7ca40bfcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d96847-a2e1-4d01-82cd-3d7ca40bfcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb807caa-9573-4534-ae7a-ea49295d3afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:39 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Volume 939c30ff-8b15-4825-abb5-6d229d89404e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-939c30ff-8b15-4825-abb5-6d229d89404e', 'volume_size': 2, 'source_volid': '50b75ce5-68ac-485f-92e8-5a8d20603d09', 'source_volstatus': 'available'}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:39 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Cloning volume 50b75ce5-68ac-485f-92e8-5a8d20603d09 to volume 939c30ff-8b15-4825-abb5-6d229d89404e
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Creating offline snapshot efd36f97-547c-41e0-aa16-7ab29b2ed5c6 of volume 50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fad1fd-89c0-46f1-8a71-4b52b86d3cae]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:39 devstack sudo[101849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09
Sep 06 17:11:39 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:39 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09" returned: 0 in 0.413s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:39 devstack sudo[101854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 1G
Sep 06 17:11:39 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:40 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 1G" returned: 0 in 0.396s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:40 devstack sudo[101860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6
Sep 06 17:11:40 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:40 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6" returned: 0 in 0.369s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:40 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 is being set with open permissions: ugo+rw
Sep 06 17:11:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:40 devstack sudo[101865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6
Sep 06 17:11:40 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:40 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:40 devstack sudo[101868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.info
Sep 06 17:11:40 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:40 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.info" returned: 0 in 0.308s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:40 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.info is being set with open permissions: ugo+rw
Sep 06 17:11:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:41 devstack sudo[101871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.info
Sep 06 17:11:41 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:41 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.info" returned: 0 in 0.304s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Acquiring lock "cinder-quobyte-939c30ff-8b15-4825-abb5-6d229d89404e" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Lock "cinder-quobyte-939c30ff-8b15-4825-abb5-6d229d89404e" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] snapshot: efd36f97-547c-41e0-aa16-7ab29b2ed5c6, volume: 939c30ff-8b15-4825-abb5-6d229d89404e,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b902eaf3-6a1c-4373-8082-ce21ba529936]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:41 devstack sudo[101874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6
Sep 06 17:11:41 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:41 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6" returned: 0 in 0.427s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50b75ce5-68ac-485f-92e8-5a8d20603d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e27670-b908-4952-beb8-38f1b101a7c7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:41 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09
Sep 06 17:11:41 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:42 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09" returned: 0 in 0.464s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:11:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:11:42 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:11:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:42 devstack sudo[101885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e
Sep 06 17:11:42 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:47 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e" returned: 0 in 5.296s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:11:47 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Converted 1024.00 MB image at 193.30 MB/s
Sep 06 17:11:47 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e is being set with open permissions: ugo+rw
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:47 devstack sudo[101900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e
Sep 06 17:11:47 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:47 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Lock "cinder-quobyte-939c30ff-8b15-4825-abb5-6d229d89404e" released by "_copy_volume_from_snapshot" :: held 6.549s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Acquiring lock "cinder-quobyte-efd36f97-547c-41e0-aa16-7ab29b2ed5c6" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Lock "cinder-quobyte-efd36f97-547c-41e0-aa16-7ab29b2ed5c6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Deleting offline snapshot efd36f97-547c-41e0-aa16-7ab29b2ed5c6 of volume 50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] snapshot_file for this snap is: volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf55e2d4-6700-465b-ba90-7d5a194e7a65]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:48 devstack sudo[101903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6
Sep 06 17:11:48 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:48 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6" returned: 0 in 0.366s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50b75ce5-68ac-485f-92e8-5a8d20603d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:11:48 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2eda4a-d35c-41bc-ad89-d8731b6214cb]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:48 devstack sudo[101908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09
Sep 06 17:11:48 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:48 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09" returned: 0 in 0.543s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:48 devstack sudo[101913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6
Sep 06 17:11:48 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:49 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6" returned: 0 in 0.406s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:49 devstack sudo[101918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6
Sep 06 17:11:49 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:49 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09.efd36f97-547c-41e0-aa16-7ab29b2ed5c6" returned: 0 in 0.265s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Lock "cinder-quobyte-efd36f97-547c-41e0-aa16-7ab29b2ed5c6" released by "_delete_snapshot" :: held 1.667s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:11:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.495s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:49 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb807caa-9573-4534-ae7a-ea49295d3afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939c30ff-8b15-4825-abb5-6d229d89404e', 'volume_size': 2, 'source_volid': '50b75ce5-68ac-485f-92e8-5a8d20603d09', 'source_volstatus': 'available'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:49 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9170e4e-4354-45b6-aa85-e4e3b9add642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:11:49 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Volume volume-939c30ff-8b15-4825-abb5-6d229d89404e (939c30ff-8b15-4825-abb5-6d229d89404e): created successfully
Sep 06 17:11:49 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9170e4e-4354-45b6-aa85-e4e3b9add642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:11:49 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Flow 'volume_create_manager' (d932086a-3b0c-459a-9630-f216239f5ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:11:49 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f213a54a-fa66-4489-af30-ffb2520d99ec tempest-VolumesCloneTest-352469998 None] Created volume successfully.
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Acquiring lock "cinder-939c30ff-8b15-4825-abb5-6d229d89404e-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Lock "cinder-939c30ff-8b15-4825-abb5-6d229d89404e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Acquiring lock "cinder-quobyte-939c30ff-8b15-4825-abb5-6d229d89404e" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Lock "cinder-quobyte-939c30ff-8b15-4825-abb5-6d229d89404e" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dbbccd-a2ae-47de-b81a-457246c2080e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:50 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e
Sep 06 17:11:50 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:50 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e" returned: 0 in 0.346s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:50 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e
Sep 06 17:11:50 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:50 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-939c30ff-8b15-4825-abb5-6d229d89404e" returned: 0 in 0.241s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Lock "cinder-quobyte-939c30ff-8b15-4825-abb5-6d229d89404e" released by "delete_volume" :: held 0.624s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:11:50 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Created reservations ['9ac668f7-a300-4a59-aa9a-5f4f5fb261ac', '27615690-050b-4442-a6df-2751306f5ffb', '6a18f8d7-7eb1-4d52-895b-0e456c8a2a1a', '4b991053-973a-47e1-8146-ac85e06b2d2b'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:51 devstack sudo[101929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:11:51 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:51 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.252s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:11:51 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Deleted volume successfully.
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4b60dce1-556b-4ffe-8b1d-1ed53de9a29d tempest-VolumesCloneTest-352469998 None] Lock "cinder-939c30ff-8b15-4825-abb5-6d229d89404e-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Acquiring lock "cinder-50b75ce5-68ac-485f-92e8-5a8d20603d09-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Lock "cinder-50b75ce5-68ac-485f-92e8-5a8d20603d09-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Acquiring lock "cinder-quobyte-50b75ce5-68ac-485f-92e8-5a8d20603d09" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Lock "cinder-quobyte-50b75ce5-68ac-485f-92e8-5a8d20603d09" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[66884392-e366-4d83-9c28-1772c7716118]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:51 devstack sudo[101944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09
Sep 06 17:11:51 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:51 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09" returned: 0 in 0.349s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:51 devstack sudo[101950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09
Sep 06 17:11:51 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:52 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-50b75ce5-68ac-485f-92e8-5a8d20603d09" returned: 0 in 0.228s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Lock "cinder-quobyte-50b75ce5-68ac-485f-92e8-5a8d20603d09" released by "delete_volume" :: held 0.629s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Created reservations ['145c3260-63f0-4251-af67-1a1fa68576cf', '2836527c-b654-4fb4-812d-3016baf3bbdb', '161715bd-52cf-4d0e-9578-0d99cff0333c', '60e2b637-f34d-4c71-94c6-2ae751b57f3a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:11:52 devstack sudo[101953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:11:52 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:11:52 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.239s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:11:52 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Deleted volume successfully.
Sep 06 17:11:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-55d9bb0e-89af-479d-b448-c25551610265 tempest-VolumesCloneTest-352469998 None] Lock "cinder-50b75ce5-68ac-485f-92e8-5a8d20603d09-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:02 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=40,cinder:UPDATE=37,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:12:02 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=37,cinder:UPDATE=41,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:12:18 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:12:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Flow 'volume_create_manager' (b887d892-1f3d-49e3-846c-78b5c02a117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6f7948-9adc-47fe-abea-c1177f34b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6f7948-9adc-47fe-abea-c1177f34b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1997315661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52582486-c3c1-4b60-9610-47f83ff1f25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6728f1943bad417d99dbd5017514e992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:19Z,use_quota=True,user_id='ae52bd1b4e754d45a3eddceac922deb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4f8d974-de85-4d8a-83fb-5e44ad5d2115),volume_type_id=e4f8d974-de85-4d8a-83fb-5e44ad5d2115)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc323263-e334-467a-87f3-05569b64d45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc323263-e334-467a-87f3-05569b64d45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1001009f-0720-4e13-aa87-d0a001bbe9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1001009f-0720-4e13-aa87-d0a001bbe9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52582486-c3c1-4b60-9610-47f83ff1f25f', 'volume_name': 'volume-52582486-c3c1-4b60-9610-47f83ff1f25f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666d8778-5375-420f-8279-e1ed24c13fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666d8778-5375-420f-8279-e1ed24c13fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ccb35c-8563-4373-958a-3cfec031b2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Volume 52582486-c3c1-4b60-9610-47f83ff1f25f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52582486-c3c1-4b60-9610-47f83ff1f25f', 'volume_size': 1}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1997315661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52582486-c3c1-4b60-9610-47f83ff1f25f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6728f1943bad417d99dbd5017514e992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:19Z,use_quota=True,user_id='ae52bd1b4e754d45a3eddceac922deb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4f8d974-de85-4d8a-83fb-5e44ad5d2115),volume_type_id=e4f8d974-de85-4d8a-83fb-5e44ad5d2115)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Creating volume 52582486-c3c1-4b60-9610-47f83ff1f25f {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:12:19 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:19 devstack sudo[102006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f 1073741824
Sep 06 17:12:19 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Flow 'volume_create_manager' (4f75ad3e-5919-47e6-bc38-e4f94959b312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb3dbb5-a99a-4f35-a454-e455bfe8fad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb3dbb5-a99a-4f35-a454-e455bfe8fad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-122946374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6728f1943bad417d99dbd5017514e992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:19Z,use_quota=True,user_id='ae52bd1b4e754d45a3eddceac922deb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(077b30f8-d4f9-4c33-a592-69101b9359c8),volume_type_id=077b30f8-d4f9-4c33-a592-69101b9359c8)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297bc980-ac3a-400d-9444-3b39360c621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297bc980-ac3a-400d-9444-3b39360c621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423a98e6-506a-45cf-bee5-8b6378f068b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423a98e6-506a-45cf-bee5-8b6378f068b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79', 'volume_name': 'volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec75566f-018d-4857-a806-b27a62b4cf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec75566f-018d-4857-a806-b27a62b4cf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c70710-fb01-46d8-80c3-dfea86ed552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:19 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Volume d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79', 'volume_size': 1}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:19 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f 1073741824" returned: 0 in 0.616s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:19 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f
Sep 06 17:12:19 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:20 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f" returned: 0 in 0.328s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-122946374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6728f1943bad417d99dbd5017514e992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:19Z,use_quota=True,user_id='ae52bd1b4e754d45a3eddceac922deb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(077b30f8-d4f9-4c33-a592-69101b9359c8),volume_type_id=077b30f8-d4f9-4c33-a592-69101b9359c8)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Creating volume d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:12:20 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:20 devstack sudo[102026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79 1073741824
Sep 06 17:12:20 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ccb35c-8563-4373-958a-3cfec031b2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52582486-c3c1-4b60-9610-47f83ff1f25f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06ab3c9-1439-4f77-a36d-ece0eab8fb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Flow 'volume_create_manager' (3603b2e5-f5d1-4f93-b774-07367c9227d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07041c43-495b-4560-a0fa-88cf3a209bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Volume volume-52582486-c3c1-4b60-9610-47f83ff1f25f (52582486-c3c1-4b60-9610-47f83ff1f25f): created successfully
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f06ab3c9-1439-4f77-a36d-ece0eab8fb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Flow 'volume_create_manager' (b887d892-1f3d-49e3-846c-78b5c02a117e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-b392eb73-c63d-4621-b005-62300c2c078c req-f0593a94-c0e7-49e4-a86b-93cda4e032f6 tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6dc59b32-eb58-4557-817e-81173d34d099 tempest-TestInstancesWithCinderVolumes-1778093211 None] Created volume successfully.
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07041c43-495b-4560-a0fa-88cf3a209bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1481514919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26e3aeb-b211-412e-a8ac-221271c4cf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6728f1943bad417d99dbd5017514e992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:20Z,use_quota=True,user_id='ae52bd1b4e754d45a3eddceac922deb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5f8bd1b-e0be-4e11-95b2-68e570aca776),volume_type_id=a5f8bd1b-e0be-4e11-95b2-68e570aca776)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68fc86e-039e-4bfb-bc57-58c8ac7978c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e68fc86e-039e-4bfb-bc57-58c8ac7978c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdccc421-bf52-4203-b616-afa61e118cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdccc421-bf52-4203-b616-afa61e118cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b26e3aeb-b211-412e-a8ac-221271c4cf39', 'volume_name': 'volume-b26e3aeb-b211-412e-a8ac-221271c4cf39', 'volume_size': 1, 'image_id': '215378ba-0748-48b7-8d2c-4a5f128338d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/215378ba-0748-48b7-8d2c-4a5f128338d7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--59822576', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6728f1943bad417d99dbd5017514e992', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '215378ba-0748-48b7-8d2c-4a5f128338d7', 'created_at': datetime.datetime(2026, 9, 6, 15, 12, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 12, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/215378ba-0748-48b7-8d2c-4a5f128338d7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe9aa120>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd2c146-fe23-4924-ae99-fffaa1a85438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd2c146-fe23-4924-ae99-fffaa1a85438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f6d5c1-18e4-491b-a3d6-da9529340eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Volume b26e3aeb-b211-412e-a8ac-221271c4cf39: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b26e3aeb-b211-412e-a8ac-221271c4cf39', 'volume_size': 1, 'image_id': '215378ba-0748-48b7-8d2c-4a5f128338d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/215378ba-0748-48b7-8d2c-4a5f128338d7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--59822576', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6728f1943bad417d99dbd5017514e992', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '215378ba-0748-48b7-8d2c-4a5f128338d7', 'created_at': datetime.datetime(2026, 9, 6, 15, 12, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 12, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/215378ba-0748-48b7-8d2c-4a5f128338d7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe9aa120>}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Trying to clone b26e3aeb-b211-412e-a8ac-221271c4cf39 from image 215378ba-0748-48b7-8d2c-4a5f128338d7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/215378ba-0748-48b7-8d2c-4a5f128338d7', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:12:20 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79 1073741824" returned: 0 in 0.436s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:20 devstack sudo[102032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79
Sep 06 17:12:20 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:20 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79" returned: 0 in 0.274s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-b392eb73-c63d-4621-b005-62300c2c078c req-f0593a94-c0e7-49e4-a86b-93cda4e032f6 tempest-TestStampPattern-904558217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.640s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c70710-fb01-46d8-80c3-dfea86ed552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e878240-0504-4885-90a9-4f49c8b53afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-b392eb73-c63d-4621-b005-62300c2c078c req-f0593a94-c0e7-49e4-a86b-93cda4e032f6 tempest-TestStampPattern-904558217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Volume volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79 (d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79): created successfully
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e878240-0504-4885-90a9-4f49c8b53afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Flow 'volume_create_manager' (4f75ad3e-5919-47e6-bc38-e4f94959b312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-24e96f0f-37c4-4162-b0e5-9b43710cee3f tempest-TestInstancesWithCinderVolumes-1778093211 None] Created volume successfully.
Sep 06 17:12:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-b392eb73-c63d-4621-b005-62300c2c078c req-f0593a94-c0e7-49e4-a86b-93cda4e032f6 tempest-TestStampPattern-904558217 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-b77992d1-44a4-4283-a6d4-b162075e7789', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adf9b903-8008-4db4-ace8-c24f145e1cdf', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:12:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-b392eb73-c63d-4621-b005-62300c2c078c req-f0593a94-c0e7-49e4-a86b-93cda4e032f6 tempest-TestStampPattern-904558217 None] attachment_update completed successfully.
Sep 06 17:12:23 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-1254f009-b4f8-4ea2-9a8f-ef2bbd02280a req-858a538f-8be0-4e62-a787-62b23862b7ce tempest-TestStampPattern-904558217 None] Terminate volume connection completed successfully.
Sep 06 17:12:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-1254f009-b4f8-4ea2-9a8f-ef2bbd02280a req-858a538f-8be0-4e62-a787-62b23862b7ce tempest-TestStampPattern-904558217 None] Deleting attachment adf9b903-8008-4db4-ace8-c24f145e1cdf. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:12:23 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD, size 20.69 MB, duration 3.23 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:12:23 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Image download 20.69 MB at 6.41 MB/s
Sep 06 17:12:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1e8188-dbaa-4da0-bd22-84e6a42c4202]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:23 devstack sudo[102460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD
Sep 06 17:12:23 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:24 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Temporary image 215378ba-0748-48b7-8d2c-4a5f128338d7 is fetched for user ae52bd1b4e754d45a3eddceac922deb0. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b386510-f150-45ae-9c80-9e3f775596ab]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:24 devstack sudo[102466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD
Sep 06 17:12:24 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:24 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1481514919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26e3aeb-b211-412e-a8ac-221271c4cf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6728f1943bad417d99dbd5017514e992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:20Z,use_quota=True,user_id='ae52bd1b4e754d45a3eddceac922deb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5f8bd1b-e0be-4e11-95b2-68e570aca776),volume_type_id=a5f8bd1b-e0be-4e11-95b2-68e570aca776)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Creating volume b26e3aeb-b211-412e-a8ac-221271c4cf39 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:12:24 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:12:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:24 devstack sudo[102471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 1073741824
Sep 06 17:12:24 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:25 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 1073741824" returned: 0 in 0.566s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:25 devstack sudo[102479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39
Sep 06 17:12:25 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:25 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39" returned: 0 in 0.377s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:12:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:25 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Attempting download of 215378ba-0748-48b7-8d2c-4a5f128338d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/215378ba-0748-48b7-8d2c-4a5f128338d7', 'metadata': {}}])) to volume b26e3aeb-b211-412e-a8ac-221271c4cf39. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:12:25 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4896857c-819a-4b3c-96ac-af8c01b22438]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_215378ba-0748-48b7-8d2c-4a5f128338d7_dsu5sdsq {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:25 devstack sudo[102503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_215378ba-0748-48b7-8d2c-4a5f128338d7_dsu5sdsq
Sep 06 17:12:25 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:26 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_215378ba-0748-48b7-8d2c-4a5f128338d7_dsu5sdsq" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_215378ba-0748-48b7-8d2c-4a5f128338d7_dsu5sdsq {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:26 devstack sudo[102509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_215378ba-0748-48b7-8d2c-4a5f128338d7_dsu5sdsq
Sep 06 17:12:26 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:26 devstack sudo[102510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:12:26 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:26 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_215378ba-0748-48b7-8d2c-4a5f128338d7_dsu5sdsq" returned: 1 in 0.440s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_215378ba-0748-48b7-8d2c-4a5f128338d7_dsu5sdsq' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[885b3cf7-62ce-4212-824d-c50416a9e678]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:26 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.364s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:12:26 devstack sudo[102519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD
Sep 06 17:12:26 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:26 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] 215378ba-0748-48b7-8d2c-4a5f128338d7 was qcow2, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:12:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:26 devstack sudo[102526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39
Sep 06 17:12:26 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Acquiring lock "cinder-b77992d1-44a4-4283-a6d4-b162075e7789-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Lock "cinder-b77992d1-44a4-4283-a6d4-b162075e7789-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Acquiring lock "cinder-quobyte-b77992d1-44a4-4283-a6d4-b162075e7789" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-b77992d1-44a4-4283-a6d4-b162075e7789" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b5e2e3-24f1-4bf6-b033-a468d86b5786]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:27 devstack sudo[102535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789
Sep 06 17:12:27 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:28 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789" returned: 0 in 0.389s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:28 devstack sudo[102540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789
Sep 06 17:12:28 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:28 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39" returned: 0 in 1.609s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_215378ba-0748-48b7-8d2c-4a5f128338d7_lwmy4x8pdevstack@QuobyteHD, size 112.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:12:28 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:28 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Converted 112.00 MB image at 69.54 MB/s
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b77992d1-44a4-4283-a6d4-b162075e7789" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:28 devstack sudo[102543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 1G
Sep 06 17:12:28 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-b77992d1-44a4-4283-a6d4-b162075e7789" released by "delete_volume" :: held 0.699s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Created reservations ['58eb5e08-6fcf-4134-a088-86a7a252d88b', '0d895cac-eecf-48fa-a27a-249271893867', '74596a50-f19d-470f-96a9-4b298215f706', 'b6f51676-fc60-4a1b-b8aa-9fe637990201'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:28 devstack sudo[102545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:12:28 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:28 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 1G" returned: 0 in 0.321s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Downloaded image 215378ba-0748-48b7-8d2c-4a5f128338d7 ((None, [{'url': 'file:///opt/stack/data/glance/images/215378ba-0748-48b7-8d2c-4a5f128338d7', 'metadata': {}}])) to volume b26e3aeb-b211-412e-a8ac-221271c4cf39 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Temporary image 215378ba-0748-48b7-8d2c-4a5f128338d7 for user ae52bd1b4e754d45a3eddceac922deb0 is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Marking volume b26e3aeb-b211-412e-a8ac-221271c4cf39 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Copying metadata from image 215378ba-0748-48b7-8d2c-4a5f128338d7 to b26e3aeb-b211-412e-a8ac-221271c4cf39. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Creating volume glance metadata for volume b26e3aeb-b211-412e-a8ac-221271c4cf39 backed by image 215378ba-0748-48b7-8d2c-4a5f128338d7 with: {'image_id': '215378ba-0748-48b7-8d2c-4a5f128338d7', 'image_name': 'tempest-scenario-img--59822576', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f6d5c1-18e4-491b-a3d6-da9529340eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26e3aeb-b211-412e-a8ac-221271c4cf39', 'volume_size': 1, 'image_id': '215378ba-0748-48b7-8d2c-4a5f128338d7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/215378ba-0748-48b7-8d2c-4a5f128338d7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--59822576', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6728f1943bad417d99dbd5017514e992', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '215378ba-0748-48b7-8d2c-4a5f128338d7', 'created_at': datetime.datetime(2026, 9, 6, 15, 12, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 12, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/215378ba-0748-48b7-8d2c-4a5f128338d7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe9aa120>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be417771-c224-4f7a-9e46-eb888f8bd37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:28 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:12:28 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Deleted volume successfully.
Sep 06 17:12:28 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Volume volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 (b26e3aeb-b211-412e-a8ac-221271c4cf39): created successfully
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be417771-c224-4f7a-9e46-eb888f8bd37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Flow 'volume_create_manager' (3603b2e5-f5d1-4f93-b774-07367c9227d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ab14e6bc-7c57-4e87-803e-ffd1631fa1a8 tempest-TestStampPattern-904558217 None] Lock "cinder-b77992d1-44a4-4283-a6d4-b162075e7789-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:28 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d1df2d56-feea-4425-831b-82fed9720da3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Created volume successfully.
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Acquiring lock "cinder-feb288f3-81ca-48a5-850b-278b96962d64-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Lock "cinder-feb288f3-81ca-48a5-850b-278b96962d64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Acquiring lock "cinder-quobyte-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Acquiring lock "cinder-quobyte-feb288f3-81ca-48a5-850b-278b96962d64" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-feb288f3-81ca-48a5-850b-278b96962d64" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Deleting offline snapshot feb288f3-81ca-48a5-850b-278b96962d64 of volume bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] snapshot_file for this snap is: volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c525fee-27e7-46fe-b477-1dfbad62bd55]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:29 devstack sudo[102551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64
Sep 06 17:12:29 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:29 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64" returned: 0 in 0.360s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a81ed2-dd0a-427e-b7ac-cb28d9c56aee]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:29 devstack sudo[102556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503
Sep 06 17:12:29 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:30 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" returned: 0 in 0.488s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:30 devstack sudo[102561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64
Sep 06 17:12:30 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:30 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64" returned: 0 in 0.366s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:30 devstack sudo[102567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64
Sep 06 17:12:30 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:30 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503.feb288f3-81ca-48a5-850b-278b96962d64" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-feb288f3-81ca-48a5-850b-278b96962d64" released by "_delete_snapshot" :: held 1.600s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" released by "delete_snapshot" :: held 1.625s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:30 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Created reservations ['acb4d145-8cc7-4f6c-b4df-0c603ea9e9bd', '4440aa44-e678-4c5d-85c1-3614ea4747fc', 'c79b5524-4ab2-4942-a101-08e765dd3b52', '9c26f5ea-91fa-4faa-9a85-58255b80e197'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:12:30 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Delete snapshot completed successfully.
Sep 06 17:12:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-919a1364-6074-4326-bfdc-11300c23d6b2 tempest-TestStampPattern-904558217 None] Lock "cinder-feb288f3-81ca-48a5-850b-278b96962d64-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-c500cc6d-609d-4d61-8464-0ddf02d69838 req-743260f7-9f06-4e22-9188-e0262e28759c tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-c500cc6d-609d-4d61-8464-0ddf02d69838 req-743260f7-9f06-4e22-9188-e0262e28759c tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-c500cc6d-609d-4d61-8464-0ddf02d69838 req-743260f7-9f06-4e22-9188-e0262e28759c tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-c500cc6d-609d-4d61-8464-0ddf02d69838 req-743260f7-9f06-4e22-9188-e0262e28759c tempest-TestInstancesWithCinderVolumes-1778093211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-b26e3aeb-b211-412e-a8ac-221271c4cf39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e879772-bebb-4580-859e-8a27e304713c', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:12:32 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-c500cc6d-609d-4d61-8464-0ddf02d69838 req-743260f7-9f06-4e22-9188-e0262e28759c tempest-TestInstancesWithCinderVolumes-1778093211 None] attachment_update completed successfully.
Sep 06 17:12:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Acquiring lock "cinder-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Lock "cinder-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Acquiring lock "cinder-quobyte-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" acquired by "delete_volume" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:35 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[819de64d-0eb2-4457-b35b-12981219603a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:36 devstack sudo[102676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503
Sep 06 17:12:36 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:36 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" returned: 0 in 0.721s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:36 devstack sudo[103038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503
Sep 06 17:12:36 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:37 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" returned: 0 in 0.497s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Lock "cinder-quobyte-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503" released by "delete_volume" :: held 1.290s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Created reservations ['87f815ad-cb52-42c0-a358-8f767bfe852d', 'ee649c0a-7514-4471-ba4d-764f199e6abc', '3a302712-033d-41bb-aa66-3d62aa1eaaae', '50fec86c-14a7-4e6e-acb7-26d99cc33049'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:37 devstack sudo[103062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:12:37 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:37 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.268s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:12:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Deleted volume successfully.
Sep 06 17:12:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a7430a18-a2f1-43a5-9759-2a7e60163ae5 tempest-TestStampPattern-904558217 None] Lock "cinder-bb7e8d8d-7828-47e7-a4e9-05fbe7d1c503-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:47 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=36,cinder:SELECT=39,cinder:DELETE=2,cinder:INSERT=12 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:12:47 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=43,cinder:UPDATE=34,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Flow 'volume_create_manager' (c34be767-e1c0-4b93-b9de-808e8eb020bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27579c40-1e5d-4254-83cd-e9cba973f6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27579c40-1e5d-4254-83cd-e9cba973f6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304924427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c15159b-7dad-4f5c-a73d-ccb400d7c8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492cb0bd2016491b9a976815103361df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:53Z,use_quota=True,user_id='3e218e9528b140af8e3df6415976584f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42975c6-78de-4fb8-ad0c-5c163eceba13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42975c6-78de-4fb8-ad0c-5c163eceba13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c74e44d-bdfb-498c-a027-5b91ba5d8724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c74e44d-bdfb-498c-a027-5b91ba5d8724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c15159b-7dad-4f5c-a73d-ccb400d7c8c7', 'volume_name': 'volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e56f683-a120-4104-90f0-5f3ff7a2d908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e56f683-a120-4104-90f0-5f3ff7a2d908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f8034b-d3ec-4966-b4ec-e6939eb2aada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:52 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Volume 8c15159b-7dad-4f5c-a73d-ccb400d7c8c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7', 'volume_size': 1}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304924427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c15159b-7dad-4f5c-a73d-ccb400d7c8c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492cb0bd2016491b9a976815103361df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:53Z,use_quota=True,user_id='3e218e9528b140af8e3df6415976584f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Creating volume 8c15159b-7dad-4f5c-a73d-ccb400d7c8c7 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:12:52 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:12:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:52 devstack sudo[103078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7 1073741824
Sep 06 17:12:52 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:53 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7 1073741824" returned: 0 in 0.495s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:53 devstack sudo[103083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7
Sep 06 17:12:53 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:53 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7" returned: 0 in 0.255s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:53 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:12:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f8034b-d3ec-4966-b4ec-e6939eb2aada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3584cb-8b0b-4a90-8f31-65f2ea9c82d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:53 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Volume volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7 (8c15159b-7dad-4f5c-a73d-ccb400d7c8c7): created successfully
Sep 06 17:12:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3584cb-8b0b-4a90-8f31-65f2ea9c82d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:53 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Flow 'volume_create_manager' (c34be767-e1c0-4b93-b9de-808e8eb020bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:53 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-97dfe3b3-cebb-425f-a348-115b7ab4d876 tempest-ProjectReaderTests-1901955056 None] Created volume successfully.
Sep 06 17:12:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Acquiring lock "cinder-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Lock "cinder-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Acquiring lock "cinder-quobyte-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Lock "cinder-quobyte-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b46dfcc-394e-44e7-8a84-00329e11b318]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:55 devstack sudo[103098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7
Sep 06 17:12:55 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:55 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7" returned: 0 in 0.368s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:55 devstack sudo[103103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7
Sep 06 17:12:55 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:55 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7" returned: 0 in 0.242s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Lock "cinder-quobyte-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7" released by "delete_volume" :: held 0.647s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Created reservations ['68d50c7f-6282-41f1-a062-5aa4a1990348', '08a585d9-b5a2-45f9-9cc8-aebbb46a7deb', 'ee82e8bb-ddc1-4597-8b9c-29694079a88f', '26ec78ae-28ea-4cac-ab75-e50b4fdc9c09'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:55 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:12:55 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:56 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.263s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:12:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Deleted volume successfully.
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aa293745-8d43-4ad1-ab6a-8186bb32328f tempest-ProjectReaderTests-1901955056 None] Lock "cinder-8c15159b-7dad-4f5c-a73d-ccb400d7c8c7-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Flow 'volume_create_manager' (a8d00e90-e9a0-407a-abc3-27fcb692365b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adecb4d9-31bb-4b33-9060-ed50585f1a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adecb4d9-31bb-4b33-9060-ed50585f1a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-152176088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a64ae6-717b-41fd-aa0a-ff03f4eb4e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492cb0bd2016491b9a976815103361df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:57Z,use_quota=True,user_id='3e218e9528b140af8e3df6415976584f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3353df0a-6a1d-45a8-8efc-da3307c34d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3353df0a-6a1d-45a8-8efc-da3307c34d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b50f495-4d7a-4a36-9dfd-446d6f18921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b50f495-4d7a-4a36-9dfd-446d6f18921c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74a64ae6-717b-41fd-aa0a-ff03f4eb4e91', 'volume_name': 'volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c97021-e513-4f9d-a626-f35792f13719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10c97021-e513-4f9d-a626-f35792f13719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24e9d6e-1a2f-4514-8369-e3dca64aa256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:56 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Volume 74a64ae6-717b-41fd-aa0a-ff03f4eb4e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91', 'volume_size': 1}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-152176088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a64ae6-717b-41fd-aa0a-ff03f4eb4e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492cb0bd2016491b9a976815103361df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:12:57Z,use_quota=True,user_id='3e218e9528b140af8e3df6415976584f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Creating volume 74a64ae6-717b-41fd-aa0a-ff03f4eb4e91 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:12:56 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:12:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:56 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91 1073741824
Sep 06 17:12:56 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:57 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91 1073741824" returned: 0 in 0.397s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:57 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91
Sep 06 17:12:57 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:57 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91" returned: 0 in 0.236s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24e9d6e-1a2f-4514-8369-e3dca64aa256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecae4e3-8bc0-4cef-9005-7c939496b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:12:57 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Volume volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91 (74a64ae6-717b-41fd-aa0a-ff03f4eb4e91): created successfully
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecae4e3-8bc0-4cef-9005-7c939496b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Flow 'volume_create_manager' (a8d00e90-e9a0-407a-abc3-27fcb692365b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:12:57 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-db7b9ee1-f8e5-40d2-af3d-33a3af5eba06 tempest-ProjectReaderTests-1901955056 None] Created volume successfully.
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Acquiring lock "cinder-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Lock "cinder-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Acquiring lock "cinder-quobyte-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Lock "cinder-quobyte-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b507b1-9aa1-4216-b2ea-fc8d0fd6f2a9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:12:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:57 devstack sudo[103142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91
Sep 06 17:12:57 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:58 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91" returned: 0 in 0.362s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:58 devstack sudo[103147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91
Sep 06 17:12:58 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:58 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91" returned: 0 in 0.237s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Lock "cinder-quobyte-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91" released by "delete_volume" :: held 0.636s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Created reservations ['6d5d0caa-a730-4657-b56a-82e6d4f6e4e3', '6727ae02-66a4-4687-b7f9-13fc0cb7dcc8', 'c9b939cc-ee93-45cb-9258-d448e5e91563', '1d6b9f9b-fed2-4bbc-8518-c6c435e3112c'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:12:58 devstack sudo[103150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:12:58 devstack sudo[103150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:12:58 devstack sudo[103150]: pam_unix(sudo:session): session closed for user root
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.239s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:12:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Deleted volume successfully.
Sep 06 17:12:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8738fa14-02aa-4814-bdcd-e66a12761dbf tempest-ProjectReaderTests-1901955056 None] Lock "cinder-74a64ae6-717b-41fd-aa0a-ff03f4eb4e91-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:13:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-f4a825f7-0af3-4b29-a06c-9a9645c0728a req-b047f109-b16a-4128-971c-6cbba0f69da9 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:13:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-f4a825f7-0af3-4b29-a06c-9a9645c0728a req-b047f109-b16a-4128-971c-6cbba0f69da9 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:13:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-f4a825f7-0af3-4b29-a06c-9a9645c0728a req-b047f109-b16a-4128-971c-6cbba0f69da9 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:13:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-f4a825f7-0af3-4b29-a06c-9a9645c0728a req-b047f109-b16a-4128-971c-6cbba0f69da9 tempest-TestInstancesWithCinderVolumes-1778093211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-52582486-c3c1-4b60-9610-47f83ff1f25f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b3e31af-4314-4051-89a5-5b839c1b7262', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:13:07 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-f4a825f7-0af3-4b29-a06c-9a9645c0728a req-b047f109-b16a-4128-971c-6cbba0f69da9 tempest-TestInstancesWithCinderVolumes-1778093211 None] attachment_update completed successfully.
Sep 06 17:13:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-d4419400-2234-44a4-9a13-ad6c07ba474e req-bb2f117b-775c-4463-bfe3-046b431bba79 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:13:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-d4419400-2234-44a4-9a13-ad6c07ba474e req-bb2f117b-775c-4463-bfe3-046b431bba79 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:13:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-d4419400-2234-44a4-9a13-ad6c07ba474e req-bb2f117b-775c-4463-bfe3-046b431bba79 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:13:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-d4419400-2234-44a4-9a13-ad6c07ba474e req-bb2f117b-775c-4463-bfe3-046b431bba79 tempest-TestInstancesWithCinderVolumes-1778093211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '137e5b7a-679f-4e32-8723-819b7b81d305', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:13:09 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-d4419400-2234-44a4-9a13-ad6c07ba474e req-bb2f117b-775c-4463-bfe3-046b431bba79 tempest-TestInstancesWithCinderVolumes-1778093211 None] attachment_update completed successfully.
Sep 06 17:13:13 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-9eefdfd9-609e-4697-8375-77dffc297d8d req-449ff6ea-0640-4f85-90e2-b9a8d7d0de44 tempest-TestInstancesWithCinderVolumes-1778093211 None] Terminate volume connection completed successfully.
Sep 06 17:13:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-9eefdfd9-609e-4697-8375-77dffc297d8d req-449ff6ea-0640-4f85-90e2-b9a8d7d0de44 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deleting attachment 7b3e31af-4314-4051-89a5-5b839c1b7262. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:13:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "cinder-52582486-c3c1-4b60-9610-47f83ff1f25f-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:13:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-52582486-c3c1-4b60-9610-47f83ff1f25f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "cinder-quobyte-52582486-c3c1-4b60-9610-47f83ff1f25f" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-quobyte-52582486-c3c1-4b60-9610-47f83ff1f25f" acquired by "delete_volume" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6c7355-e865-4663-a5fa-2e8093cd3253]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:14 devstack sudo[103268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f
Sep 06 17:13:14 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:14 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f" returned: 0 in 0.401s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:14 devstack sudo[103275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f
Sep 06 17:13:14 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:14 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-52582486-c3c1-4b60-9610-47f83ff1f25f" returned: 0 in 0.256s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-quobyte-52582486-c3c1-4b60-9610-47f83ff1f25f" released by "delete_volume" :: held 0.700s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:13:14 devstack cinder-volume[87474]: WARNING cinder.quota [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1278202814-419338002 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1278202814-419338002, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:13:14 devstack cinder-volume[87474]: WARNING cinder.quota [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1278202814-419338002 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1278202814-419338002, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Created reservations ['0b5e42eb-24bd-4e76-b33a-5dd106824a41', '820a5075-bad2-4b4f-81cc-b56ad63b566d', 'f585dcc8-8089-4bea-841e-271e58711728', '1d3691a3-599e-45c7-82c6-15b7fbe10609'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:13:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:14 devstack sudo[103278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:13:14 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:15 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.268s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:15 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:13:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deleted volume successfully.
Sep 06 17:13:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-34e16291-835f-47f9-be44-0fb309128771 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-52582486-c3c1-4b60-9610-47f83ff1f25f-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:13:17 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-97482f07-f37f-4646-9e4d-71f91d08d0b3 req-7a712373-835b-4534-890f-31f84f2002b6 tempest-TestInstancesWithCinderVolumes-1778093211 None] Terminate volume connection completed successfully.
Sep 06 17:13:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-97482f07-f37f-4646-9e4d-71f91d08d0b3 req-7a712373-835b-4534-890f-31f84f2002b6 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deleting attachment 137e5b7a-679f-4e32-8723-819b7b81d305. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "cinder-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "cinder-quobyte-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-quobyte-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79" acquired by "delete_volume" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff3b738-91c7-4f9a-bc2f-1239a62549ec]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:18 devstack sudo[103304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79
Sep 06 17:13:18 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:18 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79" returned: 0 in 0.374s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:18 devstack sudo[103309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79
Sep 06 17:13:18 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:18 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79" returned: 0 in 0.250s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-quobyte-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79" released by "delete_volume" :: held 0.674s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:13:18 devstack cinder-volume[87474]: WARNING cinder.quota [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1356119028-175507011 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1356119028-175507011, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:13:18 devstack cinder-volume[87474]: WARNING cinder.quota [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1356119028-175507011 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1356119028-175507011, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Created reservations ['40a51988-c46d-48b3-8057-642b6947d4b0', '94665c1a-e81e-4c7f-bd2f-fe3fa355864b', '5848c97c-2cdb-41b9-bc79-e068b9af51c8', 'fbd087fa-ab0b-4a13-a304-ba2dd3c62372'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:13:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:18 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:13:18 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:19 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.249s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:19 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:13:19 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deleted volume successfully.
Sep 06 17:13:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ec46481c-a9b7-4524-ae74-4d47ec45aba3 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-d1d78ad7-dd6d-46b8-a31a-b2b3aaea6c79-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:13:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-d8dc6649-54b0-455e-adfa-73fa9f965f67 req-6ba594fa-b17b-454d-b5b7-d1f6dcb5daa2 tempest-TestInstancesWithCinderVolumes-1778093211 None] Terminate volume connection completed successfully.
Sep 06 17:13:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-d8dc6649-54b0-455e-adfa-73fa9f965f67 req-6ba594fa-b17b-454d-b5b7-d1f6dcb5daa2 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deleting attachment 8e879772-bebb-4580-859e-8a27e304713c. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:13:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "cinder-b26e3aeb-b211-412e-a8ac-221271c4cf39-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:13:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-b26e3aeb-b211-412e-a8ac-221271c4cf39-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "cinder-quobyte-b26e3aeb-b211-412e-a8ac-221271c4cf39" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-quobyte-b26e3aeb-b211-412e-a8ac-221271c4cf39" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a37c68-380e-4122-846f-0ad2787a5bef]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:23 devstack sudo[103349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39
Sep 06 17:13:23 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:23 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39" returned: 0 in 0.364s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:23 devstack sudo[103354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39
Sep 06 17:13:23 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:23 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b26e3aeb-b211-412e-a8ac-221271c4cf39" returned: 0 in 0.256s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-quobyte-b26e3aeb-b211-412e-a8ac-221271c4cf39" released by "delete_volume" :: held 0.658s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:13:23 devstack cinder-volume[87474]: WARNING cinder.quota [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1616443787-177303095 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1616443787-177303095, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:13:23 devstack cinder-volume[87474]: WARNING cinder.quota [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1616443787-177303095 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1616443787-177303095, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Created reservations ['88e414ff-4ba3-419d-9d58-2c40ba225047', '61d11851-9919-4b13-af51-b443ee5b2ca1', 'b816c7c5-1286-4a0f-9f53-d62d6cdb06ce', 'ff4897a1-1f50-47d7-bbca-20e2728b58e7'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:13:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:23 devstack sudo[103357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:13:23 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:24 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.226s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:24 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:13:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Deleted volume successfully.
Sep 06 17:13:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a9f00026-98c8-4971-91de-9beae9e77713 tempest-TestInstancesWithCinderVolumes-1778093211 None] Lock "cinder-b26e3aeb-b211-412e-a8ac-221271c4cf39-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:13:26 devstack sudo[103362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:13:26 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:13:26 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.262s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:13:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:13:33 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=43,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:13:34 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=48,cinder:UPDATE=52,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Flow 'volume_create_manager' (eeb2e40d-988a-4357-9f34-16ac00693cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cf18a6-e9f8-458e-86a5-605d8a3702b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cf18a6-e9f8-458e-86a5-605d8a3702b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-154986985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1e63f9-6e29-4c9e-9722-753f02a953f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471abeb62d314ef0be758d158ccdc94a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:14:22Z,use_quota=True,user_id='242b94c671324e5990a2f4d19ee85d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aa673d-dc98-4176-92e1-44fef93728db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aa673d-dc98-4176-92e1-44fef93728db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2104fd72-98c0-46a8-8244-1f52b0b190a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2104fd72-98c0-46a8-8244-1f52b0b190a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f1e63f9-6e29-4c9e-9722-753f02a953f2', 'volume_name': 'volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45022399-8e33-46a2-964d-58d3b4c16a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45022399-8e33-46a2-964d-58d3b4c16a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89038ac5-4ca7-4ed2-bb57-e0850b2c4c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:14:22 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Volume 0f1e63f9-6e29-4c9e-9722-753f02a953f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2', 'volume_size': 1}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-154986985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1e63f9-6e29-4c9e-9722-753f02a953f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471abeb62d314ef0be758d158ccdc94a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:14:22Z,use_quota=True,user_id='242b94c671324e5990a2f4d19ee85d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Creating volume 0f1e63f9-6e29-4c9e-9722-753f02a953f2 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:14:22 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:14:22 devstack sudo[103530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2 1073741824
Sep 06 17:14:22 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:14:22 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2 1073741824" returned: 0 in 0.390s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:14:22 devstack sudo[103536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2
Sep 06 17:14:22 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:14:22 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2" returned: 0 in 0.236s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89038ac5-4ca7-4ed2-bb57-e0850b2c4c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ee8ef2-9684-4ec2-893a-d24ba7a247d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:14:22 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Volume volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2 (0f1e63f9-6e29-4c9e-9722-753f02a953f2): created successfully
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98ee8ef2-9684-4ec2-893a-d24ba7a247d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:14:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Flow 'volume_create_manager' (eeb2e40d-988a-4357-9f34-16ac00693cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:14:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c383d8e4-a8ef-4bd7-aeac-53d25dfb5934 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Created volume successfully.
Sep 06 17:14:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-716cbe08-6d1d-4268-96de-b44647cd88d7 req-c92135df-3e17-4bff-b5b4-3f6af5684391 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:14:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-716cbe08-6d1d-4268-96de-b44647cd88d7 req-c92135df-3e17-4bff-b5b4-3f6af5684391 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:14:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-716cbe08-6d1d-4268-96de-b44647cd88d7 req-c92135df-3e17-4bff-b5b4-3f6af5684391 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:14:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-716cbe08-6d1d-4268-96de-b44647cd88d7 req-c92135df-3e17-4bff-b5b4-3f6af5684391 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0f5717f-6501-43e7-9311-76c2f116773f', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:14:23 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-716cbe08-6d1d-4268-96de-b44647cd88d7 req-c92135df-3e17-4bff-b5b4-3f6af5684391 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] attachment_update completed successfully.
Sep 06 17:14:25 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-eee09775-f42b-4180-8348-dc2533d70902 req-f7a6cc12-507d-4fbd-89ca-3f1f00925156 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Terminate volume connection completed successfully.
Sep 06 17:14:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-eee09775-f42b-4180-8348-dc2533d70902 req-f7a6cc12-507d-4fbd-89ca-3f1f00925156 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Deleting attachment e0f5717f-6501-43e7-9311-76c2f116773f. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:14:26 devstack sudo[103960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:14:26 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:14:26 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.235s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Acquiring lock "cinder-0f1e63f9-6e29-4c9e-9722-753f02a953f2-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "cinder-0f1e63f9-6e29-4c9e-9722-753f02a953f2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Acquiring lock "cinder-quobyte-0f1e63f9-6e29-4c9e-9722-753f02a953f2" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "cinder-quobyte-0f1e63f9-6e29-4c9e-9722-753f02a953f2" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d1b4c-9f0e-477f-a57a-10d34b6bb8fd]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:14:26 devstack sudo[103963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2
Sep 06 17:14:26 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:14:26 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2" returned: 0 in 0.334s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:14:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:14:26 devstack sudo[103970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2
Sep 06 17:14:26 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:14:27 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0f1e63f9-6e29-4c9e-9722-753f02a953f2" returned: 0 in 0.229s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "cinder-quobyte-0f1e63f9-6e29-4c9e-9722-753f02a953f2" released by "delete_volume" :: held 0.598s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Created reservations ['144a39cd-056d-454d-a9c8-c12a1985e92a', '0c7741ec-5b6b-41f9-94d4-e0f4ef934c84', 'ce238daa-1fe1-4662-bd59-5e208ee2a69a', '65846713-3a8d-43cd-9eaa-33939364a350'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:14:27 devstack sudo[103973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:14:27 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:14:27 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.240s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:14:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Deleted volume successfully.
Sep 06 17:14:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-09b81aaf-7c76-496b-88aa-f0b47a3d6b96 tempest-TestServerVolumeAttachScenarioOldVersion-814794531 None] Lock "cinder-0f1e63f9-6e29-4c9e-9722-753f02a953f2-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:14:37 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=10,cinder:SELECT=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:14:37 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=15,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:15:00 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:15:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Flow 'volume_create_manager' (21d5a5a6-9d63-4fea-8a58-f9aba07e6e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:15:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4a9d08-56e7-4cc5-84bd-732529b44d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:15:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4a9d08-56e7-4cc5-84bd-732529b44d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-583176734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892ecc16-f395-4785-9d58-c09c6b2bbd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac2c0cde0454a63a28563997613889f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:15:01Z,use_quota=True,user_id='a94945c595a0417b98a0391b894c48e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:15:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d10418d-cd44-4098-ae9f-59e60c0eedfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:15:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d10418d-cd44-4098-ae9f-59e60c0eedfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:15:00 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9094f094-b19c-404f-8402-dff723a4df6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:15:00 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9094f094-b19c-404f-8402-dff723a4df6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '892ecc16-f395-4785-9d58-c09c6b2bbd79', 'volume_name': 'volume-892ecc16-f395-4785-9d58-c09c6b2bbd79', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe7db410>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef60abd-9a97-4333-9e7e-8487f501811a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eef60abd-9a97-4333-9e7e-8487f501811a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4581366e-fb2f-4aff-aa27-b16167561baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:15:01 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Volume 892ecc16-f395-4785-9d58-c09c6b2bbd79: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-892ecc16-f395-4785-9d58-c09c6b2bbd79', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe7db410>}
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Trying to clone 892ecc16-f395-4785-9d58-c09c6b2bbd79 from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:15:01 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Image download 20.69 MB at 20.69 MB/s
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8dec77-27dd-4272-bb90-a72308c0e564]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:01 devstack sudo[104014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD
Sep 06 17:15:01 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:01 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:01 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf is fetched for user a94945c595a0417b98a0391b894c48e4. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cfd47b-1464-480f-bb0f-da4cded3e752]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:02 devstack sudo[104023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD
Sep 06 17:15:02 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:02 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-583176734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=892ecc16-f395-4785-9d58-c09c6b2bbd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac2c0cde0454a63a28563997613889f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:15:01Z,use_quota=True,user_id='a94945c595a0417b98a0391b894c48e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Creating volume 892ecc16-f395-4785-9d58-c09c6b2bbd79 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:15:02 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:02 devstack sudo[104028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 1073741824
Sep 06 17:15:02 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:02 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 1073741824" returned: 0 in 0.388s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:02 devstack sudo[104034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79
Sep 06 17:15:02 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:03 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79" returned: 0 in 0.240s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Attempting download of 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume 892ecc16-f395-4785-9d58-c09c6b2bbd79. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[326d761e-6f71-433f-aef5-fea06d4fb708]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_r2tl2172 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:03 devstack sudo[104037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_r2tl2172
Sep 06 17:15:03 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:03 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_r2tl2172" returned: 0 in 0.313s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_r2tl2172 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:03 devstack sudo[104077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_r2tl2172
Sep 06 17:15:03 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:03 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_r2tl2172" returned: 1 in 0.316s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23f4b67c-17a9-402c-a0ff-7560fceb54cf_r2tl2172' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7694d713-9e34-4de1-aaaa-36372a666ec7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:15:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:03 devstack sudo[104081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD
Sep 06 17:15:03 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:04 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:04 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] 23f4b67c-17a9-402c-a0ff-7560fceb54cf was qcow2, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:15:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:04 devstack sudo[104086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79
Sep 06 17:15:04 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:05 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79" returned: 0 in 1.437s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23f4b67c-17a9-402c-a0ff-7560fceb54cf_s1dfz08wdevstack@QuobyteHD, size 112.00 MB, duration 1.44 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:15:05 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Converted 112.00 MB image at 77.80 MB/s
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:05 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 1G
Sep 06 17:15:05 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:05 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 1G" returned: 0 in 0.294s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Downloaded image 23f4b67c-17a9-402c-a0ff-7560fceb54cf ((None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}])) to volume 892ecc16-f395-4785-9d58-c09c6b2bbd79 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Temporary image 23f4b67c-17a9-402c-a0ff-7560fceb54cf for user a94945c595a0417b98a0391b894c48e4 is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Marking volume 892ecc16-f395-4785-9d58-c09c6b2bbd79 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Copying metadata from image 23f4b67c-17a9-402c-a0ff-7560fceb54cf to 892ecc16-f395-4785-9d58-c09c6b2bbd79. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Creating volume glance metadata for volume 892ecc16-f395-4785-9d58-c09c6b2bbd79 backed by image 23f4b67c-17a9-402c-a0ff-7560fceb54cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4581366e-fb2f-4aff-aa27-b16167561baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-892ecc16-f395-4785-9d58-c09c6b2bbd79', 'volume_size': 1, 'image_id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a4c36ad2c0a2420d87836c20fc92dc99', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23f4b67c-17a9-402c-a0ff-7560fceb54cf', 'created_at': datetime.datetime(2026, 9, 6, 14, 50, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 14, 50, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23f4b67c-17a9-402c-a0ff-7560fceb54cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe7db410>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d81e00-31cc-4202-b195-391b96f2e4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:15:05 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Volume volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 (892ecc16-f395-4785-9d58-c09c6b2bbd79): created successfully
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d81e00-31cc-4202-b195-391b96f2e4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:15:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Flow 'volume_create_manager' (21d5a5a6-9d63-4fea-8a58-f9aba07e6e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:15:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e443b354-3be9-4939-bbc4-4f22f5f88db4 tempest-TestShelveInstance-2124257944 None] Created volume successfully.
Sep 06 17:15:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-8dd2b8a7-8bc8-4d47-a6e1-b19d8c006681 req-763228b1-4f83-45fb-af5b-d2b122ec37a2 tempest-TestShelveInstance-2124257944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:15:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-8dd2b8a7-8bc8-4d47-a6e1-b19d8c006681 req-763228b1-4f83-45fb-af5b-d2b122ec37a2 tempest-TestShelveInstance-2124257944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:15:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-8dd2b8a7-8bc8-4d47-a6e1-b19d8c006681 req-763228b1-4f83-45fb-af5b-d2b122ec37a2 tempest-TestShelveInstance-2124257944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:15:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-8dd2b8a7-8bc8-4d47-a6e1-b19d8c006681 req-763228b1-4f83-45fb-af5b-d2b122ec37a2 tempest-TestShelveInstance-2124257944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-892ecc16-f395-4785-9d58-c09c6b2bbd79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4962bd50-edf1-4e10-ac16-0baa5e29f75c', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:15:08 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-8dd2b8a7-8bc8-4d47-a6e1-b19d8c006681 req-763228b1-4f83-45fb-af5b-d2b122ec37a2 tempest-TestShelveInstance-2124257944 None] attachment_update completed successfully.
Sep 06 17:15:18 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:UPDATE=8,cinder:INSERT=8,cinder:SELECT=13,cinder:DELETE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:15:18 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=4 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:15:26 devstack sudo[104573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:15:26 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:15:26 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.293s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:15:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:15:32 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:15:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-230afa9a-90c8-4149-acb6-556b52b70474 req-acff0a15-a666-43f5-a767-247f18cfd2d5 tempest-TestShelveInstance-2124257944 None] Terminate volume connection completed successfully.
Sep 06 17:15:38 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-230afa9a-90c8-4149-acb6-556b52b70474 req-acff0a15-a666-43f5-a767-247f18cfd2d5 tempest-TestShelveInstance-2124257944 None] Deleting attachment 4962bd50-edf1-4e10-ac16-0baa5e29f75c. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:15:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-39b2f88d-9896-473c-9c02-bd7520e25f97 req-200453fa-f7d8-48da-9f21-48c87da324d2 tempest-TestShelveInstance-2124257944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:15:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-39b2f88d-9896-473c-9c02-bd7520e25f97 req-200453fa-f7d8-48da-9f21-48c87da324d2 tempest-TestShelveInstance-2124257944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:15:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-39b2f88d-9896-473c-9c02-bd7520e25f97 req-200453fa-f7d8-48da-9f21-48c87da324d2 tempest-TestShelveInstance-2124257944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:15:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-39b2f88d-9896-473c-9c02-bd7520e25f97 req-200453fa-f7d8-48da-9f21-48c87da324d2 tempest-TestShelveInstance-2124257944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051', 'name': 'volume-892ecc16-f395-4785-9d58-c09c6b2bbd79', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb86a9e5-3185-4ca3-9df2-a9093c324cf6', 'enforce_multipath': True} {{(pid=87474) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 06 17:15:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-39b2f88d-9896-473c-9c02-bd7520e25f97 req-200453fa-f7d8-48da-9f21-48c87da324d2 tempest-TestShelveInstance-2124257944 None] attachment_update completed successfully.
Sep 06 17:15:50 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:15:50 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=9 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:16:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-628e3564-0663-4790-aedf-34fb9274c7c9 tempest-TestShelveInstance-2124257944 None] Terminate volume connection completed successfully.
Sep 06 17:16:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-628e3564-0663-4790-aedf-34fb9274c7c9 tempest-TestShelveInstance-2124257944 None] Deleting attachment bb86a9e5-3185-4ca3-9df2-a9093c324cf6. {{(pid=87474) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 06 17:16:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Acquiring lock "cinder-892ecc16-f395-4785-9d58-c09c6b2bbd79-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:16:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Lock "cinder-892ecc16-f395-4785-9d58-c09c6b2bbd79-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:16:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Acquiring lock "cinder-quobyte-892ecc16-f395-4785-9d58-c09c6b2bbd79" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:16:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Lock "cinder-quobyte-892ecc16-f395-4785-9d58-c09c6b2bbd79" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7038a84d-2902-4d85-990d-653d35f9fc2c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:07 devstack sudo[105209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79
Sep 06 17:16:07 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:07 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79" returned: 0 in 0.418s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:07 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79
Sep 06 17:16:07 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:07 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-892ecc16-f395-4785-9d58-c09c6b2bbd79" returned: 0 in 0.252s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Lock "cinder-quobyte-892ecc16-f395-4785-9d58-c09c6b2bbd79" released by "delete_volume" :: held 0.714s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG cinder.quota [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Created reservations ['83eeb0db-afd2-4186-839f-fa1efbf7b3a5', '6c831388-3323-42b3-b5e7-6048642b7443', '3ea95e2b-8397-4c7e-a5be-d4d451ac6d9a', '0aaf8e27-ffc9-4cbb-a70e-53db1a6d1ec6'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:16:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:07 devstack sudo[105217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:16:07 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:08 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.239s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:08 devstack cinder-volume[87474]: DEBUG cinder.manager [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:16:08 devstack cinder-volume[87474]: INFO cinder.volume.manager [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Deleted volume successfully.
Sep 06 17:16:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [req-5a9d4997-d3c7-4830-8f3a-4dc445038033 req-30ec7ca3-6f7c-4ae1-a65f-9c1615bc6e01 tempest-TestShelveInstance-2124257944 None] Lock "cinder-892ecc16-f395-4785-9d58-c09c6b2bbd79-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:16:17 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:16:18 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Flow 'volume_create_manager' (817cd2ba-0eb2-40e6-9cf2-722bca18f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f82b04-cae0-4d06-ae64-1b9cedde3b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5f82b04-cae0-4d06-ae64-1b9cedde3b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8c1418635f4c5681c0d7e90ab1b5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:16:23Z,use_quota=True,user_id='7af6fc8e28a0495eaa2198962e408f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f572bddc-e244-4e66-a871-496fba0db5f9),volume_type_id=f572bddc-e244-4e66-a871-496fba0db5f9)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcb99c9-b8de-4975-9681-cdd75c5a3ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcb99c9-b8de-4975-9681-cdd75c5a3ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18477c0f-c0bb-4645-bcf0-82a01368a3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18477c0f-c0bb-4645-bcf0-82a01368a3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8', 'volume_name': 'volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8', 'volume_size': 1, 'image_id': '3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd040bb40da0d27d539c8cc4c38c2c3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a8c1418635f4c5681c0d7e90ab1b5d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c3a0cca9ae89bcc4fdbda6b45a4a6ad7de1d198c8b64d6180b370df826efd0dbe5bece3215e577f93139835e56b0a020619fd9274cde3f18ee01425ad60e58ea', 'id': '3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'created_at': datetime.datetime(2026, 9, 6, 15, 16, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 16, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3fce9660-a4f7-4159-9456-2bfdc2b7b9b6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a0092a3470>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0874b8-742e-48fd-b9e4-e96e22b9df67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0874b8-742e-48fd-b9e4-e96e22b9df67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d213ee-c080-4d5f-a521-3348d07a7e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:23 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Volume f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8', 'volume_size': 1, 'image_id': '3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd040bb40da0d27d539c8cc4c38c2c3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a8c1418635f4c5681c0d7e90ab1b5d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c3a0cca9ae89bcc4fdbda6b45a4a6ad7de1d198c8b64d6180b370df826efd0dbe5bece3215e577f93139835e56b0a020619fd9274cde3f18ee01425ad60e58ea', 'id': '3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'created_at': datetime.datetime(2026, 9, 6, 15, 16, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 16, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3fce9660-a4f7-4159-9456-2bfdc2b7b9b6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a0092a3470>}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Trying to clone f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 from image 3fce9660-a4f7-4159-9456-2bfdc2b7b9b6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:16:23 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Image download 0.00 MB at 0.00 MB/s
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d3ff85-31c5-4180-a9d3-b7fd7569ca0e]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:23 devstack sudo[105233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD
Sep 06 17:16:23 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:24 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:24 devstack sudo[105238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD
Sep 06 17:16:24 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:24 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:16:24 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Temporary image 3fce9660-a4f7-4159-9456-2bfdc2b7b9b6 is fetched for user 7af6fc8e28a0495eaa2198962e408f90. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:16:24 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd08134-30db-4e9e-a197-88aea5087473]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:24 devstack sudo[105243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD
Sep 06 17:16:24 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:24 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:24 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD
Sep 06 17:16:24 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:25 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a8c1418635f4c5681c0d7e90ab1b5d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:16:23Z,use_quota=True,user_id='7af6fc8e28a0495eaa2198962e408f90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f572bddc-e244-4e66-a871-496fba0db5f9),volume_type_id=f572bddc-e244-4e66-a871-496fba0db5f9)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Creating volume f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:16:25 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:25 devstack sudo[105252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 1073741824
Sep 06 17:16:25 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:25 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 1073741824" returned: 0 in 0.401s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:25 devstack sudo[105257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8
Sep 06 17:16:25 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:25 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8" returned: 0 in 0.256s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Attempting download of 3fce9660-a4f7-4159-9456-2bfdc2b7b9b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'metadata': {}}])) to volume f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7138864-e511-486b-af99-70fbe17bf0f0]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_rfz1wply {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:26 devstack sudo[105260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_rfz1wply
Sep 06 17:16:26 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:26 devstack sudo[105262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:16:26 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:26 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_rfz1wply" returned: 0 in 0.316s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_rfz1wply {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:26 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.264s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:16:26 devstack sudo[105266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_rfz1wply
Sep 06 17:16:26 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:16:26 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_rfz1wply" returned: 1 in 0.325s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_rfz1wply' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2bad6f-68f0-4d49-b79a-9dbe3c65cf91]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:26 devstack sudo[105271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD
Sep 06 17:16:26 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:26 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:27 devstack sudo[105277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD
Sep 06 17:16:27 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:27 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] 3fce9660-a4f7-4159-9456-2bfdc2b7b9b6 was raw, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:27 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8
Sep 06 17:16:27 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:27 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8" returned: 0 in 0.440s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3fce9660-a4f7-4159-9456-2bfdc2b7b9b6_h6gydr19devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:16:27 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Converted 0.00 MB image at 0.00 MB/s
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:27 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 1G
Sep 06 17:16:27 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:27 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 1G" returned: 0 in 0.299s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Downloaded image 3fce9660-a4f7-4159-9456-2bfdc2b7b9b6 ((None, [{'url': 'file:///opt/stack/data/glance/images/3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'metadata': {}}])) to volume f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Temporary image 3fce9660-a4f7-4159-9456-2bfdc2b7b9b6 for user 7af6fc8e28a0495eaa2198962e408f90 is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:16:27 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Marking volume f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Copying metadata from image 3fce9660-a4f7-4159-9456-2bfdc2b7b9b6 to f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Creating volume glance metadata for volume f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 backed by image 3fce9660-a4f7-4159-9456-2bfdc2b7b9b6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cd040bb40da0d27d539c8cc4c38c2c3f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d213ee-c080-4d5f-a521-3348d07a7e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8', 'volume_size': 1, 'image_id': '3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd040bb40da0d27d539c8cc4c38c2c3f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a8c1418635f4c5681c0d7e90ab1b5d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c3a0cca9ae89bcc4fdbda6b45a4a6ad7de1d198c8b64d6180b370df826efd0dbe5bece3215e577f93139835e56b0a020619fd9274cde3f18ee01425ad60e58ea', 'id': '3fce9660-a4f7-4159-9456-2bfdc2b7b9b6', 'created_at': datetime.datetime(2026, 9, 6, 15, 16, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 16, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3fce9660-a4f7-4159-9456-2bfdc2b7b9b6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a0092a3470>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefc4bcc-a2ec-4ce0-9e62-0d3d3c8b79cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:28 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Volume volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 (f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8): created successfully
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fefc4bcc-a2ec-4ce0-9e62-0d3d3c8b79cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Flow 'volume_create_manager' (817cd2ba-0eb2-40e6-9cf2-722bca18f008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:16:28 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f4cdf271-cf07-4a52-84ab-bc46ae012e1f tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Created volume successfully.
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Acquiring lock "cinder-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "cinder-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Acquiring lock "cinder-quobyte-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "cinder-quobyte-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8" acquired by "delete_volume" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[409b2f35-3f91-449a-9ae4-b633253e6d92]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:28 devstack sudo[105292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8
Sep 06 17:16:28 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:29 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8" returned: 0 in 0.349s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:29 devstack sudo[105297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8
Sep 06 17:16:29 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:29 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8" returned: 0 in 0.239s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "cinder-quobyte-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8" released by "delete_volume" :: held 0.627s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:16:29 devstack cinder-volume[87474]: WARNING cinder.quota [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:16:29 devstack cinder-volume[87474]: WARNING cinder.quota [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Created reservations ['be9309b8-c305-485b-8d4f-07a66a4a50d2', '853df784-3e5a-4243-8797-5a4cbb18bcca', '53f924c4-c4a1-489b-ad6c-717d64faebd5', 'ee2201a3-8b5e-4cd1-992c-2a3ccc49306c'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:29 devstack sudo[105300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:16:29 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:29 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.245s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:16:29 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Deleted volume successfully.
Sep 06 17:16:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-212917aa-6659-487a-bd6f-8eb01d58fb0c tempest-VolumeAndVolumeTypeFromImageTest-1167063103 None] Lock "cinder-f53b81cc-5e8b-4628-8cbc-ad3ee385eaa8-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:16:35 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:16:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Flow 'volume_create_manager' (a89ef4c8-4603-467e-a940-8dc82607ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:16:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdff4770-eac7-4fef-aa74-5aa2d03fdfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdff4770-eac7-4fef-aa74-5aa2d03fdfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878b1985-2c5d-436b-8ee5-728b4b8d5944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4914ff792b349489d497987b5b191c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:16:36Z,use_quota=True,user_id='baa8914fafe34c498f3ab3fdf0fe9b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73834898-3faa-40dd-8e60-7b1e8baefa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73834898-3faa-40dd-8e60-7b1e8baefa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9ec911-0597-4432-bb97-0a8f8913a568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:35 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9ec911-0597-4432-bb97-0a8f8913a568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '878b1985-2c5d-436b-8ee5-728b4b8d5944', 'volume_name': 'volume-878b1985-2c5d-436b-8ee5-728b4b8d5944', 'volume_size': 1, 'image_id': 'b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c2dfe5b1d9d9335d5b4afe235946939', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4914ff792b349489d497987b5b191c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e84119153f08261ef7dfc86fad98db07a9da26ef6da426243e886da247cf1bf41b9da36613381dd2218f97a37a24caed3691118afb563b79debc3fc2f8f6f1c', 'id': 'b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'created_at': datetime.datetime(2026, 9, 6, 15, 16, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 16, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b90f3aeb-7d33-49b6-a08c-28d4966597c7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe983710>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772120d3-d994-405f-a690-328fddc28032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772120d3-d994-405f-a690-328fddc28032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623f563d-e05e-46ab-93d6-99c1e80232ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:36 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Volume 878b1985-2c5d-436b-8ee5-728b4b8d5944: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-878b1985-2c5d-436b-8ee5-728b4b8d5944', 'volume_size': 1, 'image_id': 'b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c2dfe5b1d9d9335d5b4afe235946939', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4914ff792b349489d497987b5b191c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e84119153f08261ef7dfc86fad98db07a9da26ef6da426243e886da247cf1bf41b9da36613381dd2218f97a37a24caed3691118afb563b79debc3fc2f8f6f1c', 'id': 'b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'created_at': datetime.datetime(2026, 9, 6, 15, 16, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 16, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b90f3aeb-7d33-49b6-a08c-28d4966597c7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe983710>}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Trying to clone 878b1985-2c5d-436b-8ee5-728b4b8d5944 from image b90f3aeb-7d33-49b6-a08c-28d4966597c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:16:36 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Image download 0.00 MB at 0.00 MB/s
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca36eda8-39f3-445f-a0ce-2a0f8478919a]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:36 devstack sudo[105306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD
Sep 06 17:16:36 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:36 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:36 devstack sudo[105310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD
Sep 06 17:16:36 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:36 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Temporary image b90f3aeb-7d33-49b6-a08c-28d4966597c7 is fetched for user baa8914fafe34c498f3ab3fdf0fe9b4e. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5b8e8c-1720-48cb-bf77-cc9638d22aef]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:37 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD
Sep 06 17:16:37 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:37 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD" returned: 0 in 0.318s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:37 devstack sudo[105319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD
Sep 06 17:16:37 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:37 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD" returned: 1 in 0.327s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=878b1985-2c5d-436b-8ee5-728b4b8d5944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4914ff792b349489d497987b5b191c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:16:36Z,use_quota=True,user_id='baa8914fafe34c498f3ab3fdf0fe9b4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Creating volume 878b1985-2c5d-436b-8ee5-728b4b8d5944 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:16:37 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:37 devstack sudo[105324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 1073741824
Sep 06 17:16:37 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:37 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 1073741824" returned: 0 in 0.397s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:38 devstack sudo[105329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944
Sep 06 17:16:38 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:38 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944" returned: 0 in 0.240s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Attempting download of b90f3aeb-7d33-49b6-a08c-28d4966597c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'metadata': {}}])) to volume 878b1985-2c5d-436b-8ee5-728b4b8d5944. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[af44abec-a4da-4a2b-9457-69e9ca157cd7]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b90f3aeb-7d33-49b6-a08c-28d4966597c7_60e4yhty {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:38 devstack sudo[105332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b90f3aeb-7d33-49b6-a08c-28d4966597c7_60e4yhty
Sep 06 17:16:38 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:38 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b90f3aeb-7d33-49b6-a08c-28d4966597c7_60e4yhty" returned: 0 in 0.325s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b90f3aeb-7d33-49b6-a08c-28d4966597c7_60e4yhty {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:38 devstack sudo[105336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b90f3aeb-7d33-49b6-a08c-28d4966597c7_60e4yhty
Sep 06 17:16:38 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:38 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b90f3aeb-7d33-49b6-a08c-28d4966597c7_60e4yhty" returned: 1 in 0.318s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b90f3aeb-7d33-49b6-a08c-28d4966597c7_60e4yhty' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6416cec9-fceb-425f-aa22-eedab586e518]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:39 devstack sudo[105340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD
Sep 06 17:16:39 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:39 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:39 devstack sudo[105344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD
Sep 06 17:16:39 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:39 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:16:39 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] b90f3aeb-7d33-49b6-a08c-28d4966597c7 was raw, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:16:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:39 devstack sudo[105349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944
Sep 06 17:16:39 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:40 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944" returned: 0 in 0.417s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b90f3aeb-7d33-49b6-a08c-28d4966597c7_kr1y5re2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:16:40 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Converted 0.00 MB image at 0.00 MB/s
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:40 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 1G
Sep 06 17:16:40 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:40 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 1G" returned: 0 in 0.292s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Downloaded image b90f3aeb-7d33-49b6-a08c-28d4966597c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'metadata': {}}])) to volume 878b1985-2c5d-436b-8ee5-728b4b8d5944 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Temporary image b90f3aeb-7d33-49b6-a08c-28d4966597c7 for user baa8914fafe34c498f3ab3fdf0fe9b4e is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Marking volume 878b1985-2c5d-436b-8ee5-728b4b8d5944 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Copying metadata from image b90f3aeb-7d33-49b6-a08c-28d4966597c7 to 878b1985-2c5d-436b-8ee5-728b4b8d5944. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Creating volume glance metadata for volume 878b1985-2c5d-436b-8ee5-728b4b8d5944 backed by image b90f3aeb-7d33-49b6-a08c-28d4966597c7 with: {'image_id': 'b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1c2dfe5b1d9d9335d5b4afe235946939', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623f563d-e05e-46ab-93d6-99c1e80232ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-878b1985-2c5d-436b-8ee5-728b4b8d5944', 'volume_size': 1, 'image_id': 'b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c2dfe5b1d9d9335d5b4afe235946939', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4914ff792b349489d497987b5b191c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4e84119153f08261ef7dfc86fad98db07a9da26ef6da426243e886da247cf1bf41b9da36613381dd2218f97a37a24caed3691118afb563b79debc3fc2f8f6f1c', 'id': 'b90f3aeb-7d33-49b6-a08c-28d4966597c7', 'created_at': datetime.datetime(2026, 9, 6, 15, 16, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 16, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b90f3aeb-7d33-49b6-a08c-28d4966597c7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe983710>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73002d8-54b6-4bec-b55f-f26ccee433bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:16:40 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Volume volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 (878b1985-2c5d-436b-8ee5-728b4b8d5944): created successfully
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73002d8-54b6-4bec-b55f-f26ccee433bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:16:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Flow 'volume_create_manager' (a89ef4c8-4603-467e-a940-8dc82607ff97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:16:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b97f07ea-e306-4d5d-b4c2-c0edb05799f1 tempest-VolumeImageDependencyTests-977296709 None] Created volume successfully.
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Acquiring lock "cinder-878b1985-2c5d-436b-8ee5-728b4b8d5944-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Lock "cinder-878b1985-2c5d-436b-8ee5-728b4b8d5944-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Acquiring lock "cinder-quobyte-878b1985-2c5d-436b-8ee5-728b4b8d5944" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Lock "cinder-quobyte-878b1985-2c5d-436b-8ee5-728b4b8d5944" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[31408cda-6ba9-4c85-a349-c8d73f8f823d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:41 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944
Sep 06 17:16:41 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:41 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:41 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944
Sep 06 17:16:41 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:41 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-878b1985-2c5d-436b-8ee5-728b4b8d5944" returned: 0 in 0.242s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Lock "cinder-quobyte-878b1985-2c5d-436b-8ee5-728b4b8d5944" released by "delete_volume" :: held 0.633s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Created reservations ['da256ffa-6b0c-4f51-84ac-d0f00128cb17', '01530cff-108d-4e2d-828c-e2f12af3837e', 'cdcd6dec-be08-4349-afad-cb49e454c759', 'f770d795-3d8b-49db-ae11-59a69a8dba40'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:16:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:16:41 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:16:41 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:16:42 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Sep 06 17:16:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.252s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:16:42 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:16:42 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Deleted volume successfully.
Sep 06 17:16:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-14541cc4-7703-479d-ad2f-6688e65738ae tempest-VolumeImageDependencyTests-977296709 None] Lock "cinder-878b1985-2c5d-436b-8ee5-728b4b8d5944-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:16:51 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=29,cinder:UPDATE=23,cinder:INSERT=12,cinder:DELETE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:16:52 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=22,cinder:INSERT=17,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (6f417528-9b02-4d88-a8ab-0f0e194ba280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7f7be1-759b-4516-96af-c566a7684b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7f7be1-759b-4516-96af-c566a7684b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278036559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b221227c-7c84-4c3a-8cd9-8f2c51314cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:02Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3dfd2c-2843-46cd-8421-244d5ac60320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3dfd2c-2843-46cd-8421-244d5ac60320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2996d5-8af5-4edd-8959-929803823226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc2996d5-8af5-4edd-8959-929803823226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b221227c-7c84-4c3a-8cd9-8f2c51314cb1', 'volume_name': 'volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97120e8-848c-4e99-9b3e-0f0dacea9f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a97120e8-848c-4e99-9b3e-0f0dacea9f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81bcb8c-9a2f-49a1-bb61-c3365c13749d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Volume b221227c-7c84-4c3a-8cd9-8f2c51314cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1', 'volume_size': 1}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1278036559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b221227c-7c84-4c3a-8cd9-8f2c51314cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:02Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Creating volume b221227c-7c84-4c3a-8cd9-8f2c51314cb1 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:02 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:02 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1 1073741824
Sep 06 17:17:02 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (ccd017ce-ec93-42cd-8022-c8c31b9345fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf4739f-fcfa-48e8-b024-595e09d64d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf4739f-fcfa-48e8-b024-595e09d64d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-250790700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:02Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3d30bb-05c9-4813-9dd2-ce0a3684c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3d30bb-05c9-4813-9dd2-ce0a3684c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6f7b32-44de-4496-9997-694b91c6a938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6f7b32-44de-4496-9997-694b91c6a938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3', 'volume_name': 'volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494e90e0-7e50-487b-8363-926235ac5f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494e90e0-7e50-487b-8363-926235ac5f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a392da-3256-4ed6-b57e-1ed44860b8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume 6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3', 'volume_size': 1}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (ef0be2c1-9eba-4506-b518-edd8c595a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f07e356-3bad-488e-a99a-9832664847f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f07e356-3bad-488e-a99a-9832664847f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-66536964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ac041d-ddd6-408d-8487-b4dce3d563c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:02Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d00c3a-8793-46de-a2ea-71d1a1562a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d00c3a-8793-46de-a2ea-71d1a1562a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d746e891-baa1-49a1-8470-0d47ae0ffcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d746e891-baa1-49a1-8470-0d47ae0ffcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ac041d-ddd6-408d-8487-b4dce3d563c1', 'volume_name': 'volume-41ac041d-ddd6-408d-8487-b4dce3d563c1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d95cbf-bde5-4f12-893a-251f93ca39c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d95cbf-bde5-4f12-893a-251f93ca39c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be55d06-aaff-40d0-bb49-2fba59b39eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Volume 41ac041d-ddd6-408d-8487-b4dce3d563c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ac041d-ddd6-408d-8487-b4dce3d563c1', 'volume_size': 1}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Flow 'volume_create_manager' (0f0d8caa-4102-4e1c-bb0f-4887362aa1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4b371d-1e49-4de4-b2b1-398865c6691e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4b371d-1e49-4de4-b2b1-398865c6691e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-127774630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663158d4-9125-48c5-a20e-8756f840170c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a82711af6b7456bbb311c398f4154ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:03Z,use_quota=True,user_id='59fdef398ee84cc3a4aee37af4a0568d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3801a78-0cb6-4528-a5cc-ba06dda7d6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3801a78-0cb6-4528-a5cc-ba06dda7d6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f087fa29-a762-4d13-8394-1b1bcceb8871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f087fa29-a762-4d13-8394-1b1bcceb8871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663158d4-9125-48c5-a20e-8756f840170c', 'volume_name': 'volume-663158d4-9125-48c5-a20e-8756f840170c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736463e3-a9d3-4b1b-8229-0470a029ba0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736463e3-a9d3-4b1b-8229-0470a029ba0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec3139f-0f59-4df2-ae82-d28b4cb676ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Volume 663158d4-9125-48c5-a20e-8756f840170c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663158d4-9125-48c5-a20e-8756f840170c', 'volume_size': 1}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:02 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1 1073741824" returned: 0 in 0.627s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (bde7d378-d5bb-4b65-9143-33707b883938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1df04c-4a66-4a56-99f0-f4009428eb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1df04c-4a66-4a56-99f0-f4009428eb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-244214911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84c4560-e096-4f93-9242-88bd1588e5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:03Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89d6c5a-e909-4a37-94df-347dd97c460a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89d6c5a-e909-4a37-94df-347dd97c460a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af5317f-4eb0-45e3-bf72-45e2e4693796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af5317f-4eb0-45e3-bf72-45e2e4693796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a84c4560-e096-4f93-9242-88bd1588e5bd', 'volume_name': 'volume-a84c4560-e096-4f93-9242-88bd1588e5bd', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f723471f-c95b-4625-b33c-a02d032948d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f723471f-c95b-4625-b33c-a02d032948d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8dc4a6-3466-4b7b-9041-cc4a0fd966d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Volume a84c4560-e096-4f93-9242-88bd1588e5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a84c4560-e096-4f93-9242-88bd1588e5bd', 'volume_size': 1}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:03 devstack sudo[105423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1
Sep 06 17:17:03 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (c76ddb24-5fb9-4847-81ef-6a8aa6475236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8ee4b2-311c-4813-9dbe-45494b5c39e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8ee4b2-311c-4813-9dbe-45494b5c39e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1779258884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa6db38-89e4-49d7-9678-1416fe451cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:03Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37f5a66-0fef-4b86-80b9-8c2fb82ceef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37f5a66-0fef-4b86-80b9-8c2fb82ceef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089e30b2-1208-4d91-a345-e30aa3df317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (089e30b2-1208-4d91-a345-e30aa3df317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baa6db38-89e4-49d7-9678-1416fe451cf9', 'volume_name': 'volume-baa6db38-89e4-49d7-9678-1416fe451cf9', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c270d221-d75c-4404-9280-85a896b8f9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c270d221-d75c-4404-9280-85a896b8f9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699eb041-81cd-4d8d-a78f-548f5a73c011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Volume baa6db38-89e4-49d7-9678-1416fe451cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baa6db38-89e4-49d7-9678-1416fe451cf9', 'volume_size': 1}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:03 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1" returned: 0 in 0.331s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.873s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-250790700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:02Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Creating volume 6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:03 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81bcb8c-9a2f-49a1-bb61-c3365c13749d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb1bc52-d89d-4998-9cb3-98aa7ae8b164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack sudo[105426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 1073741824
Sep 06 17:17:03 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:03 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Volume volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1 (b221227c-7c84-4c3a-8cd9-8f2c51314cb1): created successfully
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb1bc52-d89d-4998-9cb3-98aa7ae8b164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (6f417528-9b02-4d88-a8ab-0f0e194ba280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:03 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e139cbe9-3933-448e-9fcf-5e62a0dbc6b8 tempest-CreateVolumesFromImageTest-654836512 None] Created volume successfully.
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (4f3e8d1d-8d13-483c-9ed3-542c20b4581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfce1cbc-3c5b-4a6e-9a54-d6ee2fc1188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfce1cbc-3c5b-4a6e-9a54-d6ee2fc1188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-119339191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7970b9d0-7e44-4ceb-bded-7cf3586ae7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:04Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf21183-5dbf-4ab3-b109-b71c32752fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf21183-5dbf-4ab3-b109-b71c32752fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8392b2-09d8-4bab-a90f-3311fccc6e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8392b2-09d8-4bab-a90f-3311fccc6e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7970b9d0-7e44-4ceb-bded-7cf3586ae7e6', 'volume_name': 'volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66edbee4-a28d-4312-85f6-e01fd6a3181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66edbee4-a28d-4312-85f6-e01fd6a3181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800e31b2-dc8e-4b99-bddd-f4b99bbd49a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:03 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Volume 7970b9d0-7e44-4ceb-bded-7cf3586ae7e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6', 'volume_size': 1}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:03 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 1073741824" returned: 0 in 0.556s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:03 devstack sudo[105446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3
Sep 06 17:17:03 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:04 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" returned: 0 in 0.318s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-66536964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ac041d-ddd6-408d-8487-b4dce3d563c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:02Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Creating volume 41ac041d-ddd6-408d-8487-b4dce3d563c1 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:04 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a392da-3256-4ed6-b57e-1ed44860b8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:04 devstack sudo[105471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1 1073741824
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770b31fb-dc7d-42ad-9565-86e48ad47756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:04 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:04 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 (6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3): created successfully
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770b31fb-dc7d-42ad-9565-86e48ad47756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (ccd017ce-ec93-42cd-8022-c8c31b9345fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:04 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a478b8c3-abf6-4284-a5fa-461a1b61de35 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created volume successfully.
Sep 06 17:17:04 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1 1073741824" returned: 0 in 0.503s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:04 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1
Sep 06 17:17:04 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:05 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1" returned: 0 in 0.249s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.197s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-127774630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663158d4-9125-48c5-a20e-8756f840170c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a82711af6b7456bbb311c398f4154ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:03Z,use_quota=True,user_id='59fdef398ee84cc3a4aee37af4a0568d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Creating volume 663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:05 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be55d06-aaff-40d0-bb49-2fba59b39eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ac041d-ddd6-408d-8487-b4dce3d563c1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9b9d42-6657-4ca2-b9dd-1e32840f9415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:05 devstack sudo[105480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c 1073741824
Sep 06 17:17:05 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:05 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Volume volume-41ac041d-ddd6-408d-8487-b4dce3d563c1 (41ac041d-ddd6-408d-8487-b4dce3d563c1): created successfully
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf9b9d42-6657-4ca2-b9dd-1e32840f9415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (ef0be2c1-9eba-4506-b518-edd8c595a334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d2bddc64-1856-45aa-a720-a48aaec10879 tempest-CreateVolumesFromImageTest-654836512 None] Created volume successfully.
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:05 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c 1073741824" returned: 0 in 0.517s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:05 devstack sudo[105486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c
Sep 06 17:17:05 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:05 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c" returned: 0 in 0.254s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.898s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-244214911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84c4560-e096-4f93-9242-88bd1588e5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:03Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Creating volume a84c4560-e096-4f93-9242-88bd1588e5bd {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:05 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fec3139f-0f59-4df2-ae82-d28b4cb676ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663158d4-9125-48c5-a20e-8756f840170c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:05 devstack sudo[105489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd 1073741824
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbd6fae-460b-400e-96fa-82c9cc2cb553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:05 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:05 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Volume volume-663158d4-9125-48c5-a20e-8756f840170c (663158d4-9125-48c5-a20e-8756f840170c): created successfully
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbd6fae-460b-400e-96fa-82c9cc2cb553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:05 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Flow 'volume_create_manager' (0f0d8caa-4102-4e1c-bb0f-4887362aa1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5662364f-8ec9-4483-81df-9d1268ee5e2d tempest-VolumeDependencyTests-1356290234 None] Created volume successfully.
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:06 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Flow 'volume_create_manager' (883635b0-b3d2-47a1-81ed-303e228d7fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5aff4c-30d7-4294-9d53-cd453afdb9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd 1073741824" returned: 0 in 0.482s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5aff4c-30d7-4294-9d53-cd453afdb9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908b69fa-534e-4825-a35b-ad3c8ae134b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed28744b7374f63a3addb5b705ed4cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:06Z,use_quota=True,user_id='1cab2913c14a4ea38da9764e8d4e6f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b000e56-a0a6-477e-a91b-2b444f872c5d),volume_type_id=5b000e56-a0a6-477e-a91b-2b444f872c5d)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1081151a-f85a-4397-8b61-001c3d3abc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1081151a-f85a-4397-8b61-001c3d3abc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128526b8-04fa-4d5b-b215-e77290b3dc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:06 devstack sudo[105495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd
Sep 06 17:17:06 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128526b8-04fa-4d5b-b215-e77290b3dc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '908b69fa-534e-4825-a35b-ad3c8ae134b9', 'volume_name': 'volume-908b69fa-534e-4825-a35b-ad3c8ae134b9', 'volume_size': 1, 'image_id': '65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1d110097fc610802bf54d9213a111dc3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ed28744b7374f63a3addb5b705ed4cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e8b2e0e140d1bc65fdff5565402e55316bfde129ed22f7052612b7495145dfdeb282f52c401d7db192444291210056446a36d95b86ca91158d55c5e1cc4a2b6', 'id': '65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'created_at': datetime.datetime(2026, 9, 6, 15, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 17, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65afd7d4-1cd3-4db2-808b-969d86cd7a22/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008c25bb0>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a119f3c2-e69f-4a3e-af64-8899885510bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a119f3c2-e69f-4a3e-af64-8899885510bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49a6243-4b05-4faf-87b2-7faa513255e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:06 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Volume 908b69fa-534e-4825-a35b-ad3c8ae134b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-908b69fa-534e-4825-a35b-ad3c8ae134b9', 'volume_size': 1, 'image_id': '65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1d110097fc610802bf54d9213a111dc3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ed28744b7374f63a3addb5b705ed4cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e8b2e0e140d1bc65fdff5565402e55316bfde129ed22f7052612b7495145dfdeb282f52c401d7db192444291210056446a36d95b86ca91158d55c5e1cc4a2b6', 'id': '65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'created_at': datetime.datetime(2026, 9, 6, 15, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 17, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65afd7d4-1cd3-4db2-808b-969d86cd7a22/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008c25bb0>}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Trying to clone 908b69fa-534e-4825-a35b-ad3c8ae134b9 from image 65afd7d4-1cd3-4db2-808b-969d86cd7a22 at location (None, [{'url': 'file:///opt/stack/data/glance/images/65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:17:06 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd" returned: 0 in 0.263s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.395s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1779258884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baa6db38-89e4-49d7-9678-1416fe451cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:03Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Creating volume baa6db38-89e4-49d7-9678-1416fe451cf9 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:06 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:17:06 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Image download 0.00 MB at 0.00 MB/s
Sep 06 17:17:06 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9 1073741824
Sep 06 17:17:06 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8dc4a6-3466-4b7b-9041-cc4a0fd966d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84c4560-e096-4f93-9242-88bd1588e5bd', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905aeed2-5c64-4eb0-a79d-ad803813726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:06 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Volume volume-a84c4560-e096-4f93-9242-88bd1588e5bd (a84c4560-e096-4f93-9242-88bd1588e5bd): created successfully
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905aeed2-5c64-4eb0-a79d-ad803813726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (bde7d378-d5bb-4b65-9143-33707b883938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d04a7ad9-74ea-4c11-b27d-5b087017373b tempest-CreateVolumesFromImageTest-654836512 None] Created volume successfully.
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea03ae6-a719-4aac-9428-7a602e2190f8]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:06 devstack sudo[105500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD
Sep 06 17:17:06 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:07 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:07 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9 1073741824" returned: 0 in 0.514s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:07 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD
Sep 06 17:17:07 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:07 devstack sudo[105509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9
Sep 06 17:17:07 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:07 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Temporary image 65afd7d4-1cd3-4db2-808b-969d86cd7a22 is fetched for user 1cab2913c14a4ea38da9764e8d4e6f89. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:17:07 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9" returned: 0 in 0.248s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.730s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-119339191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7970b9d0-7e44-4ceb-bded-7cf3586ae7e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4d1a9193e84d499026b6b1041c7156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:04Z,use_quota=True,user_id='810af7c96f1d4855a746abdc3f55b928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Creating volume 7970b9d0-7e44-4ceb-bded-7cf3586ae7e6 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:07 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:07 devstack sudo[105516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6 1073741824
Sep 06 17:17:07 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (699eb041-81cd-4d8d-a78f-548f5a73c011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baa6db38-89e4-49d7-9678-1416fe451cf9', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d506a5-25d2-4395-a12a-d0cebd6dd111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:07 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Volume volume-baa6db38-89e4-49d7-9678-1416fe451cf9 (baa6db38-89e4-49d7-9678-1416fe451cf9): created successfully
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d506a5-25d2-4395-a12a-d0cebd6dd111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (c76ddb24-5fb9-4847-81ef-6a8aa6475236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c50fde-9675-471d-8819-d2224e676985]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:07 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f0aafa57-76ab-485a-93b4-1ceace84feec tempest-CreateVolumesFromImageTest-654836512 None] Created volume successfully.
Sep 06 17:17:07 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD
Sep 06 17:17:07 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:07 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6 1073741824" returned: 0 in 0.418s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:07 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:08 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6
Sep 06 17:17:08 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:08 devstack sudo[105525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD
Sep 06 17:17:08 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:08 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6" returned: 0 in 0.244s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.741s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800e31b2-dc8e-4b99-bddd-f4b99bbd49a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a44dfab-3d3d-4361-98de-960cd9da451d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Creating offline snapshot 5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 of volume 6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:17:08 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Volume volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6 (7970b9d0-7e44-4ceb-bded-7cf3586ae7e6): created successfully
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a44dfab-3d3d-4361-98de-960cd9da451d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Flow 'volume_create_manager' (4f3e8d1d-8d13-483c-9ed3-542c20b4581d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c60443-707a-42a3-84ac-80f2dbc65639]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:08 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:08 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e74729d8-94ba-4752-b4d1-7277f0c69309 tempest-CreateVolumesFromImageTest-654836512 None] Created volume successfully.
Sep 06 17:17:08 devstack sudo[105533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3
Sep 06 17:17:08 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:08 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" returned: 0 in 0.355s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:08 devstack sudo[105538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 1G
Sep 06 17:17:08 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:09 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 1G" returned: 0 in 0.368s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:09 devstack sudo[105543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2
Sep 06 17:17:09 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-quobyte-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6" acquired by "delete_volume" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbc69c-0666-42f6-913d-ede8be8757c3]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:09 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2" returned: 0 in 0.320s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:09 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 is being set with open permissions: ugo+rw
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:09 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2
Sep 06 17:17:09 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:09 devstack sudo[105548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6
Sep 06 17:17:09 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:09 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2" returned: 0 in 0.258s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:09 devstack sudo[105556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.info
Sep 06 17:17:09 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:09 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6" returned: 0 in 0.400s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:09 devstack sudo[105558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6
Sep 06 17:17:09 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:09 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.info" returned: 0 in 0.262s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:09 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.info is being set with open permissions: ugo+rw
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:09 devstack sudo[105561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.info
Sep 06 17:17:09 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:09 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6" returned: 0 in 0.254s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6" released by "delete_volume" :: held 0.689s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Created reservations ['29e822dc-e1ca-4427-a69d-3ba803ce40c6', '04e5a581-b38e-4d58-861a-7436cc1f8dd4', '2df2b90e-e5cd-417b-a45c-8b502112867b', '24129ba0-6687-4ed1-a9f7-548ad8904c17'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:10 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:10 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:10 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.info" returned: 0 in 0.246s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.068s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Creating offline snapshot 293d6770-d1dd-4649-8f53-243c3bdcddae of volume 663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:17:10 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-18404650-b155-4744-9f5a-79f984d03084 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Create snapshot completed successfully
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fac452b-d759-4114-8836-1ccbb73e45c6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:10 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:10 devstack sudo[105567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c
Sep 06 17:17:10 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.270s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:10 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Deleted volume successfully.
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-baa6db38-89e4-49d7-9678-1416fe451cf9-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-baa6db38-89e4-49d7-9678-1416fe451cf9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-db28ad8f-5e1f-41bd-ae97-60a6644c1118 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-7970b9d0-7e44-4ceb-bded-7cf3586ae7e6-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-quobyte-baa6db38-89e4-49d7-9678-1416fe451cf9" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-baa6db38-89e4-49d7-9678-1416fe451cf9" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47e3826-b782-475a-9e78-2458bc4a4d30]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:10 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9
Sep 06 17:17:10 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:10 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c" returned: 0 in 0.416s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:10 devstack sudo[105575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae 1G
Sep 06 17:17:10 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:10 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9" returned: 0 in 0.424s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:10 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9
Sep 06 17:17:10 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:11 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae 1G" returned: 0 in 0.549s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663158d4-9125-48c5-a20e-8756f840170c -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:11 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663158d4-9125-48c5-a20e-8756f840170c -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae
Sep 06 17:17:11 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:11 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (f22aa7e4-110c-4b08-858b-a58490f796d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67040ed-d1ce-41e1-bf78-77b5f762114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-baa6db38-89e4-49d7-9678-1416fe451cf9" returned: 0 in 0.372s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67040ed-d1ce-41e1-bf78-77b5f762114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723314364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4900130a-df68-45a1-adb4-ecdccfbe47c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:11Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a091e7c-98d3-43f2-b884-ac1da1c56416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a091e7c-98d3-43f2-b884-ac1da1c56416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b5a4f9-dbf2-4a6e-9cbe-f45efdc9878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b5a4f9-dbf2-4a6e-9cbe-f45efdc9878d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4900130a-df68-45a1-adb4-ecdccfbe47c3', 'volume_name': 'volume-4900130a-df68-45a1-adb4-ecdccfbe47c3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9454d2-a4aa-4fcd-8498-ab8cdbc6ba9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9454d2-a4aa-4fcd-8498-ab8cdbc6ba9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6020d1d6-c936-4cfe-9905-ef68b7e04b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume 4900130a-df68-45a1-adb4-ecdccfbe47c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4900130a-df68-45a1-adb4-ecdccfbe47c3', 'volume_size': 1}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-baa6db38-89e4-49d7-9678-1416fe451cf9" released by "delete_volume" :: held 0.901s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Created reservations ['9318b7db-5a6d-4f44-80ce-f73f441dc2fb', '72f06fc7-0a77-42db-8739-a9f2fd903440', '5fe40289-b686-4f42-9046-6f90328d61ee', 'b3df5444-2013-464d-96f5-567b4dcddb79'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:11 devstack sudo[105592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:11 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-a84c4560-e096-4f93-9242-88bd1588e5bd-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:11 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-a84c4560-e096-4f93-9242-88bd1588e5bd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-663158d4-9125-48c5-a20e-8756f840170c -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae" returned: 0 in 0.497s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:11 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae is being set with open permissions: ugo+rw
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:11 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae
Sep 06 17:17:11 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (7b37dfad-6791-44f9-8c1d-a2a0d05c1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b155f8-fbc4-4a61-b44b-29cd3c8bd887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-quobyte-a84c4560-e096-4f93-9242-88bd1588e5bd" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b155f8-fbc4-4a61-b44b-29cd3c8bd887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656254518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757e023d-4ddb-46fe-afbc-217e170e1962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:12Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c910e236-ec70-444d-b5ef-6b5f91cd906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c910e236-ec70-444d-b5ef-6b5f91cd906d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fde485e-3d13-448c-88ce-61fa90863034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fde485e-3d13-448c-88ce-61fa90863034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757e023d-4ddb-46fe-afbc-217e170e1962', 'volume_name': 'volume-757e023d-4ddb-46fe-afbc-217e170e1962', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d899b2-b72b-4f6e-b319-179e1310b05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d899b2-b72b-4f6e-b319-179e1310b05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df62d5d-78d9-48bc-b88a-08c2c657e77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:11 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume 757e023d-4ddb-46fe-afbc-217e170e1962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757e023d-4ddb-46fe-afbc-217e170e1962', 'volume_size': 1}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-a84c4560-e096-4f93-9242-88bd1588e5bd" acquired by "delete_volume" :: waited 0.081s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d910a1-de9a-4a7a-ab73-39ae73cbba2c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:11 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:11 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae" returned: 0 in 0.289s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.453s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Deleted volume successfully.
Sep 06 17:17:12 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd
Sep 06 17:17:12 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-d0e63b6a-9d0f-4617-9a7a-468090ae50de tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-baa6db38-89e4-49d7-9678-1416fe451cf9-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:12 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.info
Sep 06 17:17:12 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (98d0c677-4341-4520-8c9f-e5704f481ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0bbdcf-5f77-4ab3-a6c2-f7fcf9402da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0bbdcf-5f77-4ab3-a6c2-f7fcf9402da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1903032952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97650d84-aa78-4867-bf49-9a8219acca97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:12Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c895873-6052-4f0d-9954-84a4d93b8ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c895873-6052-4f0d-9954-84a4d93b8ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488232dc-25de-43e1-b3da-87ce79a9c8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488232dc-25de-43e1-b3da-87ce79a9c8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97650d84-aa78-4867-bf49-9a8219acca97', 'volume_name': 'volume-97650d84-aa78-4867-bf49-9a8219acca97', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ee88e-19ef-4fd1-b200-fadd0fe37719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ee88e-19ef-4fd1-b200-fadd0fe37719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba0b977-e991-4567-8a61-e6abc30b9aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume 97650d84-aa78-4867-bf49-9a8219acca97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97650d84-aa78-4867-bf49-9a8219acca97', 'volume_size': 1}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:12 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd" returned: 0 in 0.464s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:12 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:12 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd
Sep 06 17:17:12 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.info" returned: 0 in 0.336s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:12 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.info is being set with open permissions: ugo+rw
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:12 devstack sudo[105610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.info
Sep 06 17:17:12 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:12 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:12 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (e53ced2c-5d32-422c-8b51-94f7c4de232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcf3878-ac27-4201-99ee-2e629bf018d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.info" returned: 0 in 0.310s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-a84c4560-e096-4f93-9242-88bd1588e5bd" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.417s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=908b69fa-534e-4825-a35b-ad3c8ae134b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed28744b7374f63a3addb5b705ed4cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:06Z,use_quota=True,user_id='1cab2913c14a4ea38da9764e8d4e6f89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b000e56-a0a6-477e-a91b-2b444f872c5d),volume_type_id=5b000e56-a0a6-477e-a91b-2b444f872c5d)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Creating volume 908b69fa-534e-4825-a35b-ad3c8ae134b9 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:12 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-a84c4560-e096-4f93-9242-88bd1588e5bd" released by "delete_volume" :: held 0.910s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:12 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 1073741824
Sep 06 17:17:12 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcf3878-ac27-4201-99ee-2e629bf018d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226812197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32634d6-413c-43a2-b1ac-cdc7fecff897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:13Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79f077e-8232-4f3a-a707-207f32586f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79f077e-8232-4f3a-a707-207f32586f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c30e05-c303-4f15-81dc-c1fcdad453d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c30e05-c303-4f15-81dc-c1fcdad453d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32634d6-413c-43a2-b1ac-cdc7fecff897', 'volume_name': 'volume-f32634d6-413c-43a2-b1ac-cdc7fecff897', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace4c496-4cc9-428a-82de-908a6a2a0d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace4c496-4cc9-428a-82de-908a6a2a0d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ea65cd-f8f6-4254-9bd3-dbb2066de8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:12 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume f32634d6-413c-43a2-b1ac-cdc7fecff897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32634d6-413c-43a2-b1ac-cdc7fecff897', 'volume_size': 1}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-efa8ab94-fd6e-4f9d-98db-47cb04507c01 tempest-VolumeDependencyTests-1356290234 None] Create snapshot completed successfully
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Created reservations ['8d730e30-5cbb-435d-828a-69bc376d3a22', '76c7076e-d258-493b-92fe-82f73b0cbbfc', '1f2c89d6-43ea-4f95-80f0-53d6fa6a7f31', 'd037432e-1b43-4b88-ab2f-08f7174df584'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:13 devstack sudo[105616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:13 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:13 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 1073741824" returned: 0 in 0.530s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:13 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.332s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:13 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Deleted volume successfully.
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-78f7b51d-548f-4486-a62f-c3bf39e4c8a9 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-a84c4560-e096-4f93-9242-88bd1588e5bd-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:13 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9
Sep 06 17:17:13 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (b0c4c139-c75b-4274-bf86-77fbd3f765ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957ff2f1-642d-41fd-ae9c-c980131160d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (957ff2f1-642d-41fd-ae9c-c980131160d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1862854126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75429efb-d98f-4e47-b0a0-b7c158b2178e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:13Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe4e2f0-534f-42d8-9869-9a4a6ec0fafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe4e2f0-534f-42d8-9869-9a4a6ec0fafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4ca6e4-ea89-47cb-85b5-58531c36daf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4ca6e4-ea89-47cb-85b5-58531c36daf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75429efb-d98f-4e47-b0a0-b7c158b2178e', 'volume_name': 'volume-75429efb-d98f-4e47-b0a0-b7c158b2178e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7494760-5820-46c7-a951-2cd641cd7668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7494760-5820-46c7-a951-2cd641cd7668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ee85a2-7159-48d7-8822-12bf89a87c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:13 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume 75429efb-d98f-4e47-b0a0-b7c158b2178e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75429efb-d98f-4e47-b0a0-b7c158b2178e', 'volume_size': 1}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:13 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9" returned: 0 in 0.267s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.225s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-723314364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4900130a-df68-45a1-adb4-ecdccfbe47c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:11Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Creating volume 4900130a-df68-45a1-adb4-ecdccfbe47c3 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:13 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:13 devstack sudo[105626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3 1073741824
Sep 06 17:17:13 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Attempting download of 65afd7d4-1cd3-4db2-808b-969d86cd7a22 ((None, [{'url': 'file:///opt/stack/data/glance/images/65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'metadata': {}}])) to volume 908b69fa-534e-4825-a35b-ad3c8ae134b9. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7d4bc2-584e-49eb-9202-e547bd7cd27d]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65afd7d4-1cd3-4db2-808b-969d86cd7a22_1proh5l_ {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:13 devstack sudo[105628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65afd7d4-1cd3-4db2-808b-969d86cd7a22_1proh5l_
Sep 06 17:17:13 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-41ac041d-ddd6-408d-8487-b4dce3d563c1-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-41ac041d-ddd6-408d-8487-b4dce3d563c1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:14 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_65afd7d4-1cd3-4db2-808b-969d86cd7a22_1proh5l_" returned: 0 in 0.371s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65afd7d4-1cd3-4db2-808b-969d86cd7a22_1proh5l_ {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-quobyte-41ac041d-ddd6-408d-8487-b4dce3d563c1" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Flow 'volume_create_manager' (63772c97-b148-4343-a729-e893636da1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810ea026-65e4-4c3a-9c81-889ad7142478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810ea026-65e4-4c3a-9c81-889ad7142478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2022112592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c84ee20f-2828-4c3c-b84f-3cdc9dae94a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a82711af6b7456bbb311c398f4154ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=293d6770-d1dd-4649-8f53-243c3bdcddae,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:14Z,use_quota=True,user_id='59fdef398ee84cc3a4aee37af4a0568d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a15fa4-9954-4c13-96d3-d98a98644c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a15fa4-9954-4c13-96d3-d98a98644c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:14 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82150d42-dfde-4a5f-9a75-e6d8307e82ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82150d42-dfde-4a5f-9a75-e6d8307e82ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c84ee20f-2828-4c3c-b84f-3cdc9dae94a6', 'volume_name': 'volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6', 'volume_size': 1, 'snapshot_id': '293d6770-d1dd-4649-8f53-243c3bdcddae'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21a706e-58e4-4708-af5d-b4cfd5955c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a21a706e-58e4-4708-af5d-b4cfd5955c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:14 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65afd7d4-1cd3-4db2-808b-969d86cd7a22_1proh5l_
Sep 06 17:17:14 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f382b029-644a-46ae-935c-cd189dfcb204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:14 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Volume c84ee20f-2828-4c3c-b84f-3cdc9dae94a6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6', 'volume_size': 1, 'snapshot_id': '293d6770-d1dd-4649-8f53-243c3bdcddae'}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-41ac041d-ddd6-408d-8487-b4dce3d563c1" acquired by "delete_volume" :: waited 0.089s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3 1073741824" returned: 0 in 0.642s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5952331-ff7f-4c14-b432-b77c7a654676]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:14 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3
Sep 06 17:17:14 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:14 devstack sudo[105638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1
Sep 06 17:17:14 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:14 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65afd7d4-1cd3-4db2-808b-969d86cd7a22_1proh5l_" returned: 1 in 0.376s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_65afd7d4-1cd3-4db2-808b-969d86cd7a22_1proh5l_' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ecce38-ada6-4abe-9bef-40d9e16cf3d8]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:14 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3" returned: 0 in 0.255s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.709s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656254518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757e023d-4ddb-46fe-afbc-217e170e1962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:12Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Creating volume 757e023d-4ddb-46fe-afbc-217e170e1962 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:14 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:14 devstack sudo[105644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD
Sep 06 17:17:14 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:14 devstack sudo[105646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962 1073741824
Sep 06 17:17:14 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6020d1d6-c936-4cfe-9905-ef68b7e04b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4900130a-df68-45a1-adb4-ecdccfbe47c3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e0642f-54e6-4b99-b095-25daac26b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:14 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume volume-4900130a-df68-45a1-adb4-ecdccfbe47c3 (4900130a-df68-45a1-adb4-ecdccfbe47c3): created successfully
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e0642f-54e6-4b99-b095-25daac26b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (f22aa7e4-110c-4b08-858b-a58490f796d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:14 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-aea3731b-66c0-42a7-abda-6365b4c048f3 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created volume successfully.
Sep 06 17:17:14 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1" returned: 0 in 0.419s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:14 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1
Sep 06 17:17:14 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:14 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:14 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD
Sep 06 17:17:14 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:15 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-41ac041d-ddd6-408d-8487-b4dce3d563c1" returned: 0 in 0.331s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-41ac041d-ddd6-408d-8487-b4dce3d563c1" released by "delete_volume" :: held 0.805s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:15 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962 1073741824" returned: 0 in 0.505s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Created reservations ['854cf35f-0313-455a-8048-126443516110', '3d78c429-3db0-4840-a943-45fd2d3ae836', '5b4e4734-ff35-441f-980b-10f7182b34bc', '839fab33-450a-4ab0-86f6-b57b51788293'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:15 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962
Sep 06 17:17:15 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:15 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] 65afd7d4-1cd3-4db2-808b-969d86cd7a22 was raw, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:15 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9
Sep 06 17:17:15 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:15 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:15 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:15 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962" returned: 0 in 0.319s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.117s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1903032952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97650d84-aa78-4867-bf49-9a8219acca97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:12Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Creating volume 97650d84-aa78-4867-bf49-9a8219acca97 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:15 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df62d5d-78d9-48bc-b88a-08c2c657e77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757e023d-4ddb-46fe-afbc-217e170e1962', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8fd9e7-567c-47fc-9866-8daa30eb7245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:15 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97 1073741824
Sep 06 17:17:15 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:15 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.272s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:15 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume volume-757e023d-4ddb-46fe-afbc-217e170e1962 (757e023d-4ddb-46fe-afbc-217e170e1962): created successfully
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8fd9e7-567c-47fc-9866-8daa30eb7245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (7b37dfad-6791-44f9-8c1d-a2a0d05c1584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Deleted volume successfully.
Sep 06 17:17:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d914536b-c597-4614-b126-5e31d3d0a220 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created volume successfully.
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ce67acb8-d62a-4423-af85-5131e578dc79 tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-41ac041d-ddd6-408d-8487-b4dce3d563c1-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:15 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9" returned: 0 in 0.527s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_65afd7d4-1cd3-4db2-808b-969d86cd7a22_wka2u8jidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:17:15 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Converted 0.00 MB image at 0.00 MB/s
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:15 devstack sudo[105683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 1G
Sep 06 17:17:15 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:15 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97 1073741824" returned: 0 in 0.505s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:16 devstack sudo[105689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97
Sep 06 17:17:16 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:16 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 1G" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Downloaded image 65afd7d4-1cd3-4db2-808b-969d86cd7a22 ((None, [{'url': 'file:///opt/stack/data/glance/images/65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'metadata': {}}])) to volume 908b69fa-534e-4825-a35b-ad3c8ae134b9 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Temporary image 65afd7d4-1cd3-4db2-808b-969d86cd7a22 for user 1cab2913c14a4ea38da9764e8d4e6f89 is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Marking volume 908b69fa-534e-4825-a35b-ad3c8ae134b9 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Copying metadata from image 65afd7d4-1cd3-4db2-808b-969d86cd7a22 to 908b69fa-534e-4825-a35b-ad3c8ae134b9. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Creating volume glance metadata for volume 908b69fa-534e-4825-a35b-ad3c8ae134b9 backed by image 65afd7d4-1cd3-4db2-808b-969d86cd7a22 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1d110097fc610802bf54d9213a111dc3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49a6243-4b05-4faf-87b2-7faa513255e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-908b69fa-534e-4825-a35b-ad3c8ae134b9', 'volume_size': 1, 'image_id': '65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1d110097fc610802bf54d9213a111dc3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6ed28744b7374f63a3addb5b705ed4cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0e8b2e0e140d1bc65fdff5565402e55316bfde129ed22f7052612b7495145dfdeb282f52c401d7db192444291210056446a36d95b86ca91158d55c5e1cc4a2b6', 'id': '65afd7d4-1cd3-4db2-808b-969d86cd7a22', 'created_at': datetime.datetime(2026, 9, 6, 15, 17, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 17, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/65afd7d4-1cd3-4db2-808b-969d86cd7a22/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x77a008c25bb0>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358b49b0-8a48-456d-829d-db2bd1fb6ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:16 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Volume volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 (908b69fa-534e-4825-a35b-ad3c8ae134b9): created successfully
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358b49b0-8a48-456d-829d-db2bd1fb6ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Flow 'volume_create_manager' (883635b0-b3d2-47a1-81ed-303e228d7fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-206686cf-01d0-4c5c-ad72-ec5fd5313b10 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Created volume successfully.
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-b221227c-7c84-4c3a-8cd9-8f2c51314cb1-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:16 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.443s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-226812197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32634d6-413c-43a2-b1ac-cdc7fecff897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:13Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Creating volume f32634d6-413c-43a2-b1ac-cdc7fecff897 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:16 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ba0b977-e991-4567-8a61-e6abc30b9aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97650d84-aa78-4867-bf49-9a8219acca97', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:16 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897 1073741824
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6a42b2-8119-4c33-bae7-96f17520c228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:16 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-b221227c-7c84-4c3a-8cd9-8f2c51314cb1-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:16 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume volume-97650d84-aa78-4867-bf49-9a8219acca97 (97650d84-aa78-4867-bf49-9a8219acca97): created successfully
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6a42b2-8119-4c33-bae7-96f17520c228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (98d0c677-4341-4520-8c9f-e5704f481ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5d63261e-28ce-45a1-8a25-80de7a2fef01 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created volume successfully.
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "cinder-quobyte-b221227c-7c84-4c3a-8cd9-8f2c51314cb1" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-b221227c-7c84-4c3a-8cd9-8f2c51314cb1" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb6b54d-b5c3-40ef-ab9b-ef939ec46bb7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:16 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1
Sep 06 17:17:16 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:16 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897 1073741824" returned: 0 in 0.508s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:16 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1" returned: 0 in 0.410s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:16 devstack sudo[105703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1
Sep 06 17:17:16 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:16 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897
Sep 06 17:17:16 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:17 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b221227c-7c84-4c3a-8cd9-8f2c51314cb1" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Acquiring lock "cinder-908b69fa-534e-4825-a35b-ad3c8ae134b9-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-quobyte-b221227c-7c84-4c3a-8cd9-8f2c51314cb1" released by "delete_volume" :: held 0.731s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:17 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897" returned: 0 in 0.299s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "cinder-908b69fa-534e-4825-a35b-ad3c8ae134b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.704s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1862854126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75429efb-d98f-4e47-b0a0-b7c158b2178e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9c7c03e9174ea89d16befae91c146d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:13Z,use_quota=True,user_id='693204e010d74c4aa55ad1e155e5bdca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Creating volume 75429efb-d98f-4e47-b0a0-b7c158b2178e {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:17 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:17 devstack sudo[105709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e 1073741824
Sep 06 17:17:17 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ea65cd-f8f6-4254-9bd3-dbb2066de8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32634d6-413c-43a2-b1ac-cdc7fecff897', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232bb243-d5b0-4de9-ad81-0274c3727b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:17 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume volume-f32634d6-413c-43a2-b1ac-cdc7fecff897 (f32634d6-413c-43a2-b1ac-cdc7fecff897): created successfully
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232bb243-d5b0-4de9-ad81-0274c3727b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (e53ced2c-5d32-422c-8b51-94f7c4de232d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Acquiring lock "cinder-quobyte-908b69fa-534e-4825-a35b-ad3c8ae134b9" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:17 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1732d1ed-81e1-4aea-8788-88b27c0dd2db tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created volume successfully.
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "cinder-quobyte-908b69fa-534e-4825-a35b-ad3c8ae134b9" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Created reservations ['74f1bf95-bb6d-4526-9dac-63944db1cf05', '25a71b67-6c22-4b49-b981-ccaadba58e56', '4de28321-41f1-4add-b565-dd33c5f84b07', '823f13ce-bd5a-422a-8288-372549ffd5ca'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[118aecef-5ff7-4b98-a83b-e3f6010d67fd]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:17 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:17 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:17 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9
Sep 06 17:17:17 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:17 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.313s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:17 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Deleted volume successfully.
Sep 06 17:17:17 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e 1073741824" returned: 0 in 0.588s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-94bdbf22-b87f-4b25-869c-8c5d04b7b05f tempest-CreateVolumesFromImageTest-654836512 None] Lock "cinder-b221227c-7c84-4c3a-8cd9-8f2c51314cb1-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:17 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9" returned: 0 in 0.476s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:17 devstack sudo[105723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9
Sep 06 17:17:17 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:17 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e
Sep 06 17:17:17 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:18 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-908b69fa-534e-4825-a35b-ad3c8ae134b9" returned: 0 in 0.257s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "cinder-quobyte-908b69fa-534e-4825-a35b-ad3c8ae134b9" released by "delete_volume" :: held 0.784s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:18 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e" returned: 0 in 0.269s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.846s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "cinder-quobyte-293d6770-d1dd-4649-8f53-243c3bdcddae-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" by "_create_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ee85a2-7159-48d7-8822-12bf89a87c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75429efb-d98f-4e47-b0a0-b7c158b2178e', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b09e8e-e147-4029-b4b1-25f86f4e8cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-293d6770-d1dd-4649-8f53-243c3bdcddae-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Creating volume c84ee20f-2828-4c3c-b84f-3cdc9dae94a6 from snapshot 293d6770-d1dd-4649-8f53-243c3bdcddae {{(pid=87474) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "cinder-quobyte-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:18 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Volume volume-75429efb-d98f-4e47-b0a0-b7c158b2178e (75429efb-d98f-4e47-b0a0-b7c158b2178e): created successfully
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b09e8e-e147-4029-b4b1-25f86f4e8cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Flow 'volume_create_manager' (b0c4c139-c75b-4274-bf86-77fbd3f765ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] snapshot: 293d6770-d1dd-4649-8f53-243c3bdcddae, volume: c84ee20f-2828-4c3c-b84f-3cdc9dae94a6,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-32e0238f-ddf8-4987-bc8e-c6ff614260d8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created volume successfully.
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Created reservations ['8c75f692-deb3-478d-8cc3-208d1190c371', 'fa4944c4-90c0-47af-a4ba-b88ac6720bb7', '395c32f8-9668-482a-aea6-3640504a05a4', 'd4a62f23-5bf3-4624-905b-66d62b75c659'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d4d9f4-3141-4686-8a3d-9b110f16c075]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:18 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae
Sep 06 17:17:18 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:18 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:18 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:18 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.290s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Deleted volume successfully.
Sep 06 17:17:18 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-27ffab69-51c0-48db-9136-b38c9a019105 tempest-VolumeAndVolumeTypeFromImageTest-50661473 None] Lock "cinder-908b69fa-534e-4825-a35b-ad3c8ae134b9-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae" returned: 0 in 0.431s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663158d4-9125-48c5-a20e-8756f840170c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1037b1-334d-493f-abf1-d98336caf039]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:18 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c
Sep 06 17:17:18 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-75429efb-d98f-4e47-b0a0-b7c158b2178e-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-75429efb-d98f-4e47-b0a0-b7c158b2178e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-quobyte-75429efb-d98f-4e47-b0a0-b7c158b2178e" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-75429efb-d98f-4e47-b0a0-b7c158b2178e" acquired by "delete_volume" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4276aa3-f5ad-4fde-9110-2303e2c1dc7d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:19 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c" returned: 0 in 0.484s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6 not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:19 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6
Sep 06 17:17:19 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:19 devstack sudo[105745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e
Sep 06 17:17:19 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:19 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e" returned: 0 in 0.467s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:19 devstack sudo[105758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e
Sep 06 17:17:19 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:20 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-75429efb-d98f-4e47-b0a0-b7c158b2178e" returned: 0 in 0.405s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-75429efb-d98f-4e47-b0a0-b7c158b2178e" released by "delete_volume" :: held 0.944s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:20 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created reservations ['155fb1e3-b666-4d64-ba58-b020a18fe346', 'de885028-28f0-44d7-926d-8f37c31179fa', 'ef0929fc-c4b2-42c2-9ca0-6bd2d8a7fe2b', 'bbe56e38-a576-463a-b19b-f0ffe7329439'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:20 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:20 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-f32634d6-413c-43a2-b1ac-cdc7fecff897-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-f32634d6-413c-43a2-b1ac-cdc7fecff897-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-quobyte-f32634d6-413c-43a2-b1ac-cdc7fecff897" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-f32634d6-413c-43a2-b1ac-cdc7fecff897" acquired by "delete_volume" :: waited 0.041s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:22 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87bec58-dcfd-4673-b09b-6f47fb095e30]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:22 devstack sudo[105773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897
Sep 06 17:17:22 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:22 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 1.812s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:22 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Deleted volume successfully.
Sep 06 17:17:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-c6839593-aa6b-41fd-9537-efac033b5655 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-75429efb-d98f-4e47-b0a0-b7c158b2178e-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:22 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897" returned: 0 in 0.645s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:22 devstack sudo[105779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897
Sep 06 17:17:22 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:23 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f32634d6-413c-43a2-b1ac-cdc7fecff897" returned: 0 in 0.636s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-f32634d6-413c-43a2-b1ac-cdc7fecff897" released by "delete_volume" :: held 1.385s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:23 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created reservations ['733aae41-7e4a-409f-8a0f-7f29f54e6896', '0f195692-64fb-4a01-889f-8211b29a0f0a', 'eedbf7f0-5525-4275-9fea-b18b7606ab0d', '6f496a45-1737-402d-aac3-ea1ede112c10'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:23 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:23 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-97650d84-aa78-4867-bf49-9a8219acca97-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-97650d84-aa78-4867-bf49-9a8219acca97-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-quobyte-97650d84-aa78-4867-bf49-9a8219acca97" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-97650d84-aa78-4867-bf49-9a8219acca97" acquired by "delete_volume" :: waited 0.058s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:24 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.907s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:24 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Deleted volume successfully.
Sep 06 17:17:24 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a42ea7f-fb78-44b0-b43b-f729128d81cc]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e5ce5588-7c8a-4db4-b466-df8165f6d57e tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-f32634d6-413c-43a2-b1ac-cdc7fecff897-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:24 devstack sudo[105786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97
Sep 06 17:17:24 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:25 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:25 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" returned: 0 in 6.095s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:17:25 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Converted 1024.00 MB image at 167.98 MB/s
Sep 06 17:17:25 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6 is being set with open permissions: ugo+rw
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97" returned: 0 in 0.623s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:25 devstack sudo[105792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6
Sep 06 17:17:25 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:25 devstack sudo[105793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97
Sep 06 17:17:25 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:25 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" returned: 0 in 0.360s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" released by "_copy_volume_from_snapshot" :: held 7.484s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:25 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-97650d84-aa78-4867-bf49-9a8219acca97" returned: 0 in 0.394s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-97650d84-aa78-4867-bf49-9a8219acca97" released by "delete_volume" :: held 1.169s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-293d6770-d1dd-4649-8f53-243c3bdcddae-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" released by "_create_volume_from_snapshot" :: held 7.591s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.631s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f382b029-644a-46ae-935c-cd189dfcb204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6', 'volume_size': 1, 'snapshot_id': '293d6770-d1dd-4649-8f53-243c3bdcddae'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c99270-357a-4b9f-bdb6-8cd4747cd47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:25 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Volume volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6 (c84ee20f-2828-4c3c-b84f-3cdc9dae94a6): created successfully
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c99270-357a-4b9f-bdb6-8cd4747cd47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Flow 'volume_create_manager' (63772c97-b148-4343-a729-e893636da1e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:25 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5533973c-154b-4af0-adc0-a6f31e704f35 tempest-VolumeDependencyTests-1356290234 None] Created volume successfully.
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created reservations ['64a7058d-a940-4353-8129-6b376b64798f', 'cf145481-9e2d-4128-9d59-8e978a8f5716', 'f25c6faf-e7dd-41ca-949b-fa3062d8affa', 'c3acc7af-1a60-402d-9e6c-e07c77b59273'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:25 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:25 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:26 devstack sudo[105800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:26 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "cinder-293d6770-d1dd-4649-8f53-243c3bdcddae-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-293d6770-d1dd-4649-8f53-243c3bdcddae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "cinder-quobyte-663158d4-9125-48c5-a20e-8756f840170c" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-663158d4-9125-48c5-a20e-8756f840170c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "cinder-quobyte-293d6770-d1dd-4649-8f53-243c3bdcddae" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:26 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.378s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-293d6770-d1dd-4649-8f53-243c3bdcddae" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Deleting offline snapshot 293d6770-d1dd-4649-8f53-243c3bdcddae of volume 663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] snapshot_file for this snap is: volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:17:26 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Deleted volume successfully.
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4238d59d-9255-4387-94e1-fa55e1d2e1d9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eb9a3a33-c907-4aed-9ab8-fcab2714e1eb tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-97650d84-aa78-4867-bf49-9a8219acca97-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:26 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.334s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:17:26 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae
Sep 06 17:17:26 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-757e023d-4ddb-46fe-afbc-217e170e1962-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-757e023d-4ddb-46fe-afbc-217e170e1962-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:26 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae" returned: 0 in 0.570s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-663158d4-9125-48c5-a20e-8756f840170c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39315df-75a6-465c-9755-4b97ebd0f858]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-quobyte-757e023d-4ddb-46fe-afbc-217e170e1962" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-757e023d-4ddb-46fe-afbc-217e170e1962" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a669ace8-71a8-4b34-a2a8-33876406e514]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:27 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c
Sep 06 17:17:27 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:27 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962
Sep 06 17:17:27 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:27 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962" returned: 0 in 0.466s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:27 devstack sudo[105820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962
Sep 06 17:17:27 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:27 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c" returned: 0 in 0.681s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:27 devstack sudo[105823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae
Sep 06 17:17:27 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:27 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-757e023d-4ddb-46fe-afbc-217e170e1962" returned: 0 in 0.296s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-757e023d-4ddb-46fe-afbc-217e170e1962" released by "delete_volume" :: held 0.820s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:27 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created reservations ['6e9c4ed0-5ff0-4aaf-83c3-4a3db090a4ce', 'bcd077de-37e7-4bcb-8449-0fa2ee39b1d7', '9979f157-c948-4a52-959c-caabcd80e696', '5521ad5c-d524-43bb-9c88-4e41e82aa2d7'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:28 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:28 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-4900130a-df68-45a1-adb4-ecdccfbe47c3-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-4900130a-df68-45a1-adb4-ecdccfbe47c3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:28 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae" returned: 0 in 0.526s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-quobyte-4900130a-df68-45a1-adb4-ecdccfbe47c3" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:28 devstack sudo[105831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-4900130a-df68-45a1-adb4-ecdccfbe47c3" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:28 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[401ce873-da11-4a65-83d7-952e51207d7f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:28 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.413s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:28 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Deleted volume successfully.
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9240f222-2714-4f8a-a0e9-ef082096a1dd tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-757e023d-4ddb-46fe-afbc-217e170e1962-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:28 devstack sudo[105833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3
Sep 06 17:17:28 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:28 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c.293d6770-d1dd-4649-8f53-243c3bdcddae" returned: 0 in 0.358s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-293d6770-d1dd-4649-8f53-243c3bdcddae" released by "_delete_snapshot" :: held 2.274s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-663158d4-9125-48c5-a20e-8756f840170c" released by "delete_snapshot" :: held 2.312s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Created reservations ['34b89ca2-5636-468f-ac6a-2a7caf5a2cc2', '194dbfc6-8dff-42ef-8b16-612b297b8fd6', '5cb28dcd-84fc-4b9b-81f9-9368b846db29', '6b37934e-bc92-4a4c-9a4a-a3311630bc05'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:28 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Delete snapshot completed successfully.
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7c9c4207-56a7-4d49-977c-cdce4ccdd05b tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-293d6770-d1dd-4649-8f53-243c3bdcddae-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:28 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3" returned: 0 in 0.521s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:28 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3
Sep 06 17:17:28 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:29 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4900130a-df68-45a1-adb4-ecdccfbe47c3" returned: 0 in 0.289s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-4900130a-df68-45a1-adb4-ecdccfbe47c3" released by "delete_volume" :: held 0.893s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (1ffacef9-8485-4faf-8537-1efa1cc2f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61ba03b-5435-49f0-a9dd-39fc9961bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61ba03b-5435-49f0-a9dd-39fc9961bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050676532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57374485-3cd6-4c47-abb3-b9c434772be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:29Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ab3221-b165-453e-b40a-4fe0a042c56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ab3221-b165-453e-b40a-4fe0a042c56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d9615b-5f5e-43f6-b7e8-21a2d39fa533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d9615b-5f5e-43f6-b7e8-21a2d39fa533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57374485-3cd6-4c47-abb3-b9c434772be2', 'volume_name': 'volume-57374485-3cd6-4c47-abb3-b9c434772be2', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c02cf92-ba35-43d6-91cc-4234cafdfb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c02cf92-ba35-43d6-91cc-4234cafdfb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496cee2a-f45e-49ff-917d-3dd60f205312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:29 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume 57374485-3cd6-4c47-abb3-b9c434772be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57374485-3cd6-4c47-abb3-b9c434772be2', 'volume_size': 1}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1050676532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57374485-3cd6-4c47-abb3-b9c434772be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:29Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Creating volume 57374485-3cd6-4c47-abb3-b9c434772be2 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:29 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:29 devstack sudo[105843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2 1073741824
Sep 06 17:17:29 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created reservations ['87fff6ce-1818-4b3c-8f63-763fa1420282', '6c5e3933-027e-4781-9c93-c2401c72393e', '47108556-ba67-40ea-93c4-ce50418d9d35', '0b5b4c7d-ce45-4d96-b5f8-5ac07a885554'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:29 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:29 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "cinder-663158d4-9125-48c5-a20e-8756f840170c-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-663158d4-9125-48c5-a20e-8756f840170c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "cinder-quobyte-663158d4-9125-48c5-a20e-8756f840170c" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-663158d4-9125-48c5-a20e-8756f840170c" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd90f1b-df34-412c-b13f-0919b2a8da21]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:29 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.358s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:29 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Deleted volume successfully.
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-61733ad2-cc6a-45a4-bbd3-90f7a2bf5365 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-4900130a-df68-45a1-adb4-ecdccfbe47c3-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:29 devstack sudo[105851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c
Sep 06 17:17:29 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:29 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2 1073741824" returned: 0 in 0.553s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:29 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2
Sep 06 17:17:29 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:30 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c" returned: 0 in 0.433s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:30 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:30 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c
Sep 06 17:17:30 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2" returned: 0 in 0.280s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496cee2a-f45e-49ff-917d-3dd60f205312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57374485-3cd6-4c47-abb3-b9c434772be2', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ed374a-0032-4e2d-83cb-1f0db0c6baf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:30 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume volume-57374485-3cd6-4c47-abb3-b9c434772be2 (57374485-3cd6-4c47-abb3-b9c434772be2): created successfully
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6ed374a-0032-4e2d-83cb-1f0db0c6baf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (1ffacef9-8485-4faf-8537-1efa1cc2f762) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:30 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0c16bdae-92bd-48a3-844e-20e0122f63c9 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created volume successfully.
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:30 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-663158d4-9125-48c5-a20e-8756f840170c" returned: 0 in 0.277s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-quobyte-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-663158d4-9125-48c5-a20e-8756f840170c" released by "delete_volume" :: held 0.775s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-quobyte-5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Deleting offline snapshot 5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 of volume 6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] snapshot_file for this snap is: volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8388b4ac-6340-4d4c-9062-6d62000524cb]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Created reservations ['90a723b5-836f-4b86-bc98-3ca5e9fd545c', '9b9c8d78-46a1-47b1-83b6-3ee51b6cb298', 'f9329b34-1da1-44f2-8aef-73aa1f7a27e4', '612143f9-6250-4119-ae4f-94f294fa7d68'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:30 devstack sudo[105864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2
Sep 06 17:17:30 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:30 devstack sudo[105866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:30 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "cinder-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "cinder-quobyte-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a6468-c032-4d95-b934-d16972e009ca]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:30 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2" returned: 0 in 0.450s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:17:30 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.352s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:30 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:30 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Deleted volume successfully.
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6b04cc-7eb6-4e2d-9534-429ab4307ed7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-fe5b2541-5561-412d-9f14-2665d30ecf08 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-663158d4-9125-48c5-a20e-8756f840170c-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:31 devstack sudo[105872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6
Sep 06 17:17:31 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:31 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3
Sep 06 17:17:31 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:31 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" returned: 0 in 0.430s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:31 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6
Sep 06 17:17:31 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:31 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" returned: 0 in 0.448s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:31 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2
Sep 06 17:17:31 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:31 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" returned: 0 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-quobyte-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6" released by "delete_volume" :: held 0.832s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Created reservations ['7ad57ff0-7ce2-4e87-a49d-fdbadff14f3e', 'f890847c-86f9-4ed6-9142-855190b0e782', '1ce63c1e-2e30-4e53-95ca-c258dc8c53c2', '1d140ccb-3d19-4037-b231-d87bbc1615c4'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:32 devstack sudo[105892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:32 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:32 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2" returned: 0 in 0.569s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:32 devstack sudo[105894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2
Sep 06 17:17:32 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (830ba217-1078-44fc-ada1-f7655e8c0f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8da970-e859-48cf-97cd-58a1a362c25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8da970-e859-48cf-97cd-58a1a362c25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-678986191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0417f4bc-bab5-4fa6-9be2-b4ff195c5e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:32Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b89cbc-47b1-4e09-b460-c4789806f650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b89cbc-47b1-4e09-b460-c4789806f650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3ec420-7c8d-4f69-83cf-1e11ba7143c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f3ec420-7c8d-4f69-83cf-1e11ba7143c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0417f4bc-bab5-4fa6-9be2-b4ff195c5e83', 'volume_name': 'volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fdf6be-abfa-460c-952b-4e033aba93a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fdf6be-abfa-460c-952b-4e033aba93a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f20e1b-3ae8-4490-b8ce-f50eaf8df754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume 0417f4bc-bab5-4fa6-9be2-b4ff195c5e83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83', 'volume_size': 1}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-678986191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0417f4bc-bab5-4fa6-9be2-b4ff195c5e83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:32Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Creating volume 0417f4bc-bab5-4fa6-9be2-b4ff195c5e83 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:32 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:32 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83 1073741824
Sep 06 17:17:32 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:32 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:32 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Deleted volume successfully.
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5580cff5-5451-4c75-9064-aad7d8b3a406 tempest-VolumeDependencyTests-1356290234 None] Lock "cinder-c84ee20f-2828-4c3c-b84f-3cdc9dae94a6-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:32 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3.5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2" returned: 0 in 0.446s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2" released by "_delete_snapshot" :: held 2.087s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" released by "delete_snapshot" :: held 2.118s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (c17bfaa4-6c01-472a-81ef-6b461038818f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483055ac-5eb5-4133-a31e-f28191828fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483055ac-5eb5-4133-a31e-f28191828fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1680838147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9edb9b5-3477-43ad-8627-611523998953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:32Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6c783f-4870-43b2-939c-bcf9eda447dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6c783f-4870-43b2-939c-bcf9eda447dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d6a712-2410-4df3-9dc4-5d2e0ca04058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d6a712-2410-4df3-9dc4-5d2e0ca04058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9edb9b5-3477-43ad-8627-611523998953', 'volume_name': 'volume-c9edb9b5-3477-43ad-8627-611523998953', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16394e76-8a00-4118-b65e-5cef836e18b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16394e76-8a00-4118-b65e-5cef836e18b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56f3b4a-1c7e-4b16-8e73-621023c0d9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume c9edb9b5-3477-43ad-8627-611523998953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9edb9b5-3477-43ad-8627-611523998953', 'volume_size': 1}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created reservations ['06a4c00f-3137-4fc5-baaf-1b8475753e98', '4027e5b4-2ed0-44da-a7b9-a23a209af9d9', 'faf7baea-0722-4b4c-b6fb-608bf96fd893', '708f411a-aac1-4f5d-a198-85411c0c6cfc'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:32 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Delete snapshot completed successfully.
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-eab181ee-3373-4c2f-9bcb-3798af1ee2a8 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-5d1fe7d2-fcb0-4eb1-87a3-6c4cf3a1cff2-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:32 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83 1073741824" returned: 0 in 0.756s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:33 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83
Sep 06 17:17:33 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (7a18c430-d85c-4082-972b-a301c1ed91e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d44554-311e-4ba2-b013-d58d40b8fba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d44554-311e-4ba2-b013-d58d40b8fba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1402058671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17371922-da3c-4806-bce1-1b83e6dacb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:33Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6705208-2f33-4078-8275-0fa403fa49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6705208-2f33-4078-8275-0fa403fa49b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88867659-5153-47ae-8184-6752ce735269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88867659-5153-47ae-8184-6752ce735269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17371922-da3c-4806-bce1-1b83e6dacb0a', 'volume_name': 'volume-17371922-da3c-4806-bce1-1b83e6dacb0a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eaa1fad-04d6-4fb8-9bb5-a262221500de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eaa1fad-04d6-4fb8-9bb5-a262221500de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bc330b-75be-43dd-81cf-44c9662dc7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume 17371922-da3c-4806-bce1-1b83e6dacb0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17371922-da3c-4806-bce1-1b83e6dacb0a', 'volume_size': 1}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83" returned: 0 in 0.479s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1680838147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9edb9b5-3477-43ad-8627-611523998953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:32Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Creating volume c9edb9b5-3477-43ad-8627-611523998953 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:33 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f20e1b-3ae8-4490-b8ce-f50eaf8df754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd544726-307b-44c2-986c-fab69aa46b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack sudo[105907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953 1073741824
Sep 06 17:17:33 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (8089fe6c-013d-4aaa-b8e0-7e9890eaf24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa859c5-cf06-49ff-a964-19df8c90a652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83 (0417f4bc-bab5-4fa6-9be2-b4ff195c5e83): created successfully
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd544726-307b-44c2-986c-fab69aa46b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (830ba217-1078-44fc-ada1-f7655e8c0f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa859c5-cf06-49ff-a964-19df8c90a652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1083477971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88c67f8-a06b-4a1c-85da-9d06ed16ccfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:33Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a1d77b-694a-4161-8eec-f34cf8e0f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a1d77b-694a-4161-8eec-f34cf8e0f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb151620-e56f-4ee3-9890-29bd9289344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb151620-e56f-4ee3-9890-29bd9289344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd88c67f8-a06b-4a1c-85da-9d06ed16ccfb', 'volume_name': 'volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61580b2f-ede2-4eed-b20a-0701fa228e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61580b2f-ede2-4eed-b20a-0701fa228e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a603fd79-ef03-45f2-a87d-810c438c1561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:33 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume d88c67f8-a06b-4a1c-85da-9d06ed16ccfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb', 'volume_size': 1}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-d9b24a21-3047-460c-941a-106ea80ad78b tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created volume successfully.
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (729e2219-681b-4590-9a85-11b8080db9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8990cc79-b7a1-4bf7-91af-e8ef1b42c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8990cc79-b7a1-4bf7-91af-e8ef1b42c164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-486214368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1942e398-1c05-4e05-bd26-f77f9f092735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:34Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad82c91a-5203-46b9-b4f5-3a15db27e1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad82c91a-5203-46b9-b4f5-3a15db27e1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7519dfb2-13ea-484f-aa82-23a763462287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7519dfb2-13ea-484f-aa82-23a763462287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1942e398-1c05-4e05-bd26-f77f9f092735', 'volume_name': 'volume-1942e398-1c05-4e05-bd26-f77f9f092735', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8c11ea-494b-44e4-96ef-4c261134d244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8c11ea-494b-44e4-96ef-4c261134d244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a7ea57-b9a8-4818-97b9-902e144b2416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume 1942e398-1c05-4e05-bd26-f77f9f092735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1942e398-1c05-4e05-bd26-f77f9f092735', 'volume_size': 1}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "cinder-quobyte-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98d976-c4c3-4242-a599-f14daaf38d0b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:34 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953 1073741824" returned: 0 in 0.764s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:34 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3
Sep 06 17:17:34 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:34 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953
Sep 06 17:17:34 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:34 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953" returned: 0 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1402058671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17371922-da3c-4806-bce1-1b83e6dacb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:33Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Creating volume 17371922-da3c-4806-bce1-1b83e6dacb0a {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:34 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c56f3b4a-1c7e-4b16-8e73-621023c0d9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9edb9b5-3477-43ad-8627-611523998953', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:34 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a 1073741824
Sep 06 17:17:34 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:34 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13775100-5c98-4e87-b484-4d201bfb75fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" returned: 0 in 0.504s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume volume-c9edb9b5-3477-43ad-8627-611523998953 (c9edb9b5-3477-43ad-8627-611523998953): created successfully
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13775100-5c98-4e87-b484-4d201bfb75fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:34 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3
Sep 06 17:17:34 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (c17bfaa4-6c01-472a-81ef-6b461038818f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a0612513-a1bf-4edd-aa84-db647c8f0a4a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created volume successfully.
Sep 06 17:17:35 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" returned: 0 in 0.327s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-quobyte-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3" released by "delete_volume" :: held 0.912s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Created reservations ['8a254484-4eef-4012-bb66-a7e05b5550c7', '3b7d5d7c-719f-4aee-a1c7-c4be2438d351', 'e0abb0fa-d62e-4c20-8b71-508059e73e8d', '9a7a58d5-bb7f-46bd-a06f-745b6a2a30e0'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:35 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a 1073741824" returned: 0 in 0.686s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:35 devstack sudo[105932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:35 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:35 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a
Sep 06 17:17:35 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:35 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Deleted volume successfully.
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1f7127d7-0f6f-4cec-be9f-92f437b1e071 tempest-CreateVolumesFromSnapshotTest-1427915299 None] Lock "cinder-6aa25b4b-dbc3-4190-9f59-5946c3dd1ca3-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:35 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a" returned: 0 in 0.386s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.030s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1083477971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d88c67f8-a06b-4a1c-85da-9d06ed16ccfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:33Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Creating volume d88c67f8-a06b-4a1c-85da-9d06ed16ccfb {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:35 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bc330b-75be-43dd-81cf-44c9662dc7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17371922-da3c-4806-bce1-1b83e6dacb0a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:35 devstack sudo[105938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb 1073741824
Sep 06 17:17:35 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51642450-18b3-4dd1-8cc3-52f4222fb131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume volume-17371922-da3c-4806-bce1-1b83e6dacb0a (17371922-da3c-4806-bce1-1b83e6dacb0a): created successfully
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51642450-18b3-4dd1-8cc3-52f4222fb131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (7a18c430-d85c-4082-972b-a301c1ed91e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5f8578ee-17f8-4601-b996-7517842afa41 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created volume successfully.
Sep 06 17:17:36 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb 1073741824" returned: 0 in 0.549s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:36 devstack sudo[105944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb
Sep 06 17:17:36 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:36 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-486214368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1942e398-1c05-4e05-bd26-f77f9f092735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d63eafabb042499bc2b3cf1a4aec02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:34Z,use_quota=True,user_id='88722ecd77e84096afeff610a792a9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Creating volume 1942e398-1c05-4e05-bd26-f77f9f092735 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:36 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a603fd79-ef03-45f2-a87d-810c438c1561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7f8d33-fe69-49c4-b198-c63474a0935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:36 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735 1073741824
Sep 06 17:17:36 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:36 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb (d88c67f8-a06b-4a1c-85da-9d06ed16ccfb): created successfully
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e7f8d33-fe69-49c4-b198-c63474a0935d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:36 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (8089fe6c-013d-4aaa-b8e0-7e9890eaf24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f704b6a6-8d31-4c74-8802-76593467a19a tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created volume successfully.
Sep 06 17:17:37 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735 1073741824" returned: 0 in 0.604s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:37 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735
Sep 06 17:17:37 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:37 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735" returned: 0 in 0.383s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a7ea57-b9a8-4818-97b9-902e144b2416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1942e398-1c05-4e05-bd26-f77f9f092735', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d9fe66-80d2-42fe-88b4-b9f60fd121f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:37 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Volume volume-1942e398-1c05-4e05-bd26-f77f9f092735 (1942e398-1c05-4e05-bd26-f77f9f092735): created successfully
Sep 06 17:17:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d9fe66-80d2-42fe-88b4-b9f60fd121f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:37 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Flow 'volume_create_manager' (729e2219-681b-4590-9a85-11b8080db9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f7876f5d-223f-4457-82fc-5d7dae50d4cf tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created volume successfully.
Sep 06 17:17:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-1942e398-1c05-4e05-bd26-f77f9f092735-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-1942e398-1c05-4e05-bd26-f77f9f092735-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-quobyte-1942e398-1c05-4e05-bd26-f77f9f092735" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-1942e398-1c05-4e05-bd26-f77f9f092735" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:38 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea3af60-5f95-4b9c-aede-c1c76dbc73ba]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:38 devstack sudo[105957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735
Sep 06 17:17:38 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:39 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735" returned: 0 in 0.450s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:39 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735
Sep 06 17:17:39 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:39 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1942e398-1c05-4e05-bd26-f77f9f092735" returned: 0 in 0.354s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Flow 'volume_create_manager' (c45510f1-cc81-4355-9c1b-7645d488b71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a8e7c7-fa30-400b-b345-8806770455ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-1942e398-1c05-4e05-bd26-f77f9f092735" released by "delete_volume" :: held 0.906s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a8e7c7-fa30-400b-b345-8806770455ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813415857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd029f21-8682-4592-8961-3c4d03dcf75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972144ef94df4bdabecc360681d04eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:39Z,use_quota=True,user_id='90100477414b42418185d9500bb03e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a39a6ef-62da-42b9-9961-0369d220777d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a39a6ef-62da-42b9-9961-0369d220777d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250546d0-e9e3-45b3-ae08-fd8a90ad2ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250546d0-e9e3-45b3-ae08-fd8a90ad2ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd029f21-8682-4592-8961-3c4d03dcf75c', 'volume_name': 'volume-bd029f21-8682-4592-8961-3c4d03dcf75c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0342e841-76e8-48ae-bea7-93b73452dc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0342e841-76e8-48ae-bea7-93b73452dc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c9c746-01c5-4197-8d1f-6e104a296ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:39 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Volume bd029f21-8682-4592-8961-3c4d03dcf75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd029f21-8682-4592-8961-3c4d03dcf75c', 'volume_size': 1}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813415857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd029f21-8682-4592-8961-3c4d03dcf75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972144ef94df4bdabecc360681d04eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:39Z,use_quota=True,user_id='90100477414b42418185d9500bb03e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Creating volume bd029f21-8682-4592-8961-3c4d03dcf75c {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:39 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:39 devstack sudo[105965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c 1073741824
Sep 06 17:17:39 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created reservations ['8bb43721-6c95-40af-95cc-f61f3e7f8e0c', '9c97b0ac-8388-45b6-a192-3e3de1ef2730', '720867e6-22d1-42f2-a864-9984c6d96d06', '4c057ad4-8442-457b-bb32-62426c43b569'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:39 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:39 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:40 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:40 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Flow 'volume_create_manager' (ebc19573-3c68-4339-93f7-009eb098339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646781b9-5253-4fdd-81f3-90f396cf6486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.384s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c 1073741824" returned: 0 in 0.621s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Deleted volume successfully.
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (646781b9-5253-4fdd-81f3-90f396cf6486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce82990f-2a0f-40da-861b-29d97c47f6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f4fef22b08456e9b1c98b29cc800bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:40Z,use_quota=True,user_id='c8bfbf5cd3dd40819b5eda46e5a3d64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e458f-035e-40a2-857f-08a19536841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522e458f-035e-40a2-857f-08a19536841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537470e0-4deb-4921-8961-8ccf1d2aacb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537470e0-4deb-4921-8961-8ccf1d2aacb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce82990f-2a0f-40da-861b-29d97c47f6b1', 'volume_name': 'volume-ce82990f-2a0f-40da-861b-29d97c47f6b1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fce0020-8e21-4bbb-ac4b-b8b95c4cd979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fce0020-8e21-4bbb-ac4b-b8b95c4cd979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b91cee6-df1b-4383-a2eb-81369ac3d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:40 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Volume ce82990f-2a0f-40da-861b-29d97c47f6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce82990f-2a0f-40da-861b-29d97c47f6b1', 'volume_size': 1}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4761f03a-2469-4a6b-90d9-97aa166632d0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-1942e398-1c05-4e05-bd26-f77f9f092735-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:40 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c
Sep 06 17:17:40 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:40 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce82990f-2a0f-40da-861b-29d97c47f6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f4fef22b08456e9b1c98b29cc800bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:40Z,use_quota=True,user_id='c8bfbf5cd3dd40819b5eda46e5a3d64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Creating volume ce82990f-2a0f-40da-861b-29d97c47f6b1 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:40 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c9c746-01c5-4197-8d1f-6e104a296ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd029f21-8682-4592-8961-3c4d03dcf75c', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:40 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1 1073741824
Sep 06 17:17:40 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcdd140-a685-4d95-a19e-37e109405f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:40 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Volume volume-bd029f21-8682-4592-8961-3c4d03dcf75c (bd029f21-8682-4592-8961-3c4d03dcf75c): created successfully
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebcdd140-a685-4d95-a19e-37e109405f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Flow 'volume_create_manager' (c45510f1-cc81-4355-9c1b-7645d488b71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-feffce18-5e7c-4a7e-8676-91445798ae51 tempest-ProjectReaderTests-1311792641 None] Created volume successfully.
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-quobyte-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d89386-a69a-4096-9a11-b7718e69c02a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:41 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb
Sep 06 17:17:41 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:41 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1 1073741824" returned: 0 in 0.530s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:41 devstack sudo[105985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1
Sep 06 17:17:41 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:41 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Flow 'volume_create_manager' (23db6099-7a52-466c-b61e-3f8d44b4b26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac01bc2b-4c47-4038-b080-32a61c0c9c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb" returned: 0 in 0.433s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:41 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac01bc2b-4c47-4038-b080-32a61c0c9c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6180bd-b162-4f19-a950-335ffa0051f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5b468d51664030a53fe762976c211a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:41Z,use_quota=True,user_id='0d9676ef4670448292ff9efbed9bb335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:41 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c49fd5e-278e-40ef-b6cd-013bb3e44c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c49fd5e-278e-40ef-b6cd-013bb3e44c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fabc049-998d-420e-a82a-0d7219e06041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.image.glance [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Creating Keystone auth plugin from conf {{(pid=87474) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 06 17:17:41 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1" returned: 0 in 0.265s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b91cee6-df1b-4383-a2eb-81369ac3d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce82990f-2a0f-40da-861b-29d97c47f6b1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e786292b-6072-46e0-ac54-b1f88a1cd017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:41 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Volume volume-ce82990f-2a0f-40da-861b-29d97c47f6b1 (ce82990f-2a0f-40da-861b-29d97c47f6b1): created successfully
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e786292b-6072-46e0-ac54-b1f88a1cd017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Flow 'volume_create_manager' (ebc19573-3c68-4339-93f7-009eb098339e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c96f9561-64da-498b-a538-e3e0fee03ac7 tempest-CinderUnicodeTest-39425226 None] Created volume successfully.
Sep 06 17:17:41 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb" returned: 0 in 0.325s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb" released by "delete_volume" :: held 0.805s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created reservations ['da49f037-355d-4128-ac35-d4eeb2ea8866', 'eb1d0c2c-25b3-418d-9086-aa42e476814b', '04af4cfd-cf7b-4ac6-a49b-d72e0077b24e', '207eaeec-234c-4a7b-8c00-5c1f719e24b6'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fabc049-998d-420e-a82a-0d7219e06041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf6180bd-b162-4f19-a950-335ffa0051f8', 'volume_name': 'volume-bf6180bd-b162-4f19-a950-335ffa0051f8', 'volume_size': 1, 'image_id': '3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0c1e0182a2609b21a5648a42bae92db', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d5b468d51664030a53fe762976c211a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df1d8be171b360d5e14a64dc28e45939ce43a5cb7b9a6b1fd755cff98eb370da453c221055123be41e51c1625b6163de35346a925cacf69740e461380f5bf1f4', 'id': '3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'created_at': datetime.datetime(2026, 9, 6, 15, 17, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d37470d-1dbc-429b-b17f-b6acfe53d1a9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe84be00>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d70bc67-ed0f-467d-9a6b-2df3c9ea5fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d70bc67-ed0f-467d-9a6b-2df3c9ea5fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb02263-3e39-4afa-9e36-d7d650ae40a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:41 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Volume bf6180bd-b162-4f19-a950-335ffa0051f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf6180bd-b162-4f19-a950-335ffa0051f8', 'volume_size': 1, 'image_id': '3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0c1e0182a2609b21a5648a42bae92db', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d5b468d51664030a53fe762976c211a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df1d8be171b360d5e14a64dc28e45939ce43a5cb7b9a6b1fd755cff98eb370da453c221055123be41e51c1625b6163de35346a925cacf69740e461380f5bf1f4', 'id': '3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'created_at': datetime.datetime(2026, 9, 6, 15, 17, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d37470d-1dbc-429b-b17f-b6acfe53d1a9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe84be00>}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Trying to clone bf6180bd-b162-4f19-a950-335ffa0051f8 from image 3d37470d-1dbc-429b-b17f-b6acfe53d1a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'metadata': {}}]). {{(pid=87474) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Acquiring lock "cinder-bd029f21-8682-4592-8961-3c4d03dcf75c-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Lock "cinder-bd029f21-8682-4592-8961-3c4d03dcf75c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Acquiring lock "cinder-quobyte-bd029f21-8682-4592-8961-3c4d03dcf75c" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 06 17:17:41 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Image download 0.00 MB at 0.00 MB/s
Sep 06 17:17:41 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:41 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:41 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Lock "cinder-quobyte-bd029f21-8682-4592-8961-3c4d03dcf75c" acquired by "delete_volume" :: waited 0.052s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2278d3fc-e164-40ca-bc32-b56b6ea19daa]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-17371922-da3c-4806-bce1-1b83e6dacb0a-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-17371922-da3c-4806-bce1-1b83e6dacb0a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[807caf54-74b3-4620-a346-a90253aeef9e]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-quobyte-17371922-da3c-4806-bce1-1b83e6dacb0a" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:42 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c
Sep 06 17:17:42 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-17371922-da3c-4806-bce1-1b83e6dacb0a" acquired by "delete_volume" :: waited 0.039s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405ddbd-659e-4f30-a4da-5a90138d267b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:42 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD
Sep 06 17:17:42 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:42 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.351s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:42 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Deleted volume successfully.
Sep 06 17:17:42 devstack sudo[106001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a
Sep 06 17:17:42 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-daa7774f-e205-48a1-8005-27324f288d17 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-d88c67f8-a06b-4a1c-85da-9d06ed16ccfb-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:42 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:42 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c" returned: 0 in 0.526s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:42 devstack sudo[106011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c
Sep 06 17:17:42 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:42 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD
Sep 06 17:17:42 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:42 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a" returned: 0 in 0.472s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:42 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a
Sep 06 17:17:42 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:42 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd029f21-8682-4592-8961-3c4d03dcf75c" returned: 0 in 0.297s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Lock "cinder-quobyte-bd029f21-8682-4592-8961-3c4d03dcf75c" released by "delete_volume" :: held 0.886s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:42 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD" returned: 1 in 0.458s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Temporary image 3d37470d-1dbc-429b-b17f-b6acfe53d1a9 is fetched for user 0d9676ef4670448292ff9efbed9bb335. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 06 17:17:42 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Created reservations ['8fbe7bd5-5f55-44bb-a65b-d40eb8cae189', '283ce843-7c4b-4cbb-8c20-5f891c115fe3', 'df035229-f185-40e4-8afc-3fc6d98c9417', 'd266cd6a-c50e-468c-9030-30bbe7e8969f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:43 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-17371922-da3c-4806-bce1-1b83e6dacb0a" returned: 0 in 0.350s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Flow 'volume_create_manager' (3ebad774-c4a5-4357-b648-acc1b5956e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ed6fde-eb4e-44a1-9047-532272449704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-17371922-da3c-4806-bce1-1b83e6dacb0a" released by "delete_volume" :: held 0.920s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ed6fde-eb4e-44a1-9047-532272449704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-85811596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4674ee-299c-4363-b5f7-bd45074c1c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f4fef22b08456e9b1c98b29cc800bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:43Z,use_quota=True,user_id='c8bfbf5cd3dd40819b5eda46e5a3d64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b966186e-9eb8-4e6d-8020-be11e87144ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b966186e-9eb8-4e6d-8020-be11e87144ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9a660a-7c07-40dc-99f8-150c3572af3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9a660a-7c07-40dc-99f8-150c3572af3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c4674ee-299c-4363-b5f7-bd45074c1c7d', 'volume_name': 'volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69abcae-6700-483b-96bf-79f038a82123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69abcae-6700-483b-96bf-79f038a82123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d0f672-d76b-48d8-816d-b693111cf514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:43 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Volume 7c4674ee-299c-4363-b5f7-bd45074c1c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d', 'volume_size': 1}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-85811596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c4674ee-299c-4363-b5f7-bd45074c1c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f4fef22b08456e9b1c98b29cc800bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:43Z,use_quota=True,user_id='c8bfbf5cd3dd40819b5eda46e5a3d64b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Creating volume 7c4674ee-299c-4363-b5f7-bd45074c1c7d {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:43 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5b691-1782-4459-8638-6c84e2b9a988]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:43 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d 1073741824
Sep 06 17:17:43 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:43 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:43 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created reservations ['69f37c40-5bf0-4708-9c92-8130a577df56', 'ce73c4f6-8aee-4987-a71f-950cd91b961c', 'ab463ecf-f944-4a1b-87f9-596f04e5d3c9', '016a0a98-a987-41c5-b8d7-d32522025f57'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:43 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD
Sep 06 17:17:43 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:43 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:43 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:43 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.287s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Deleted volume successfully.
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-49346755-8d3f-4257-8f27-d0bcfa3090a8 tempest-ProjectReaderTests-1311792641 None] Lock "cinder-bd029f21-8682-4592-8961-3c4d03dcf75c-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:43 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:43 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Deleted volume successfully.
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6bcf1904-7555-4dea-ab63-0d20cb4bdc6c tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-17371922-da3c-4806-bce1-1b83e6dacb0a-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:43 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD
Sep 06 17:17:43 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:43 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d 1073741824" returned: 0 in 0.575s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:43 devstack sudo[106042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d
Sep 06 17:17:43 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:43 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:17:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:44 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d" returned: 0 in 0.277s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.142s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6180bd-b162-4f19-a950-335ffa0051f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5b468d51664030a53fe762976c211a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:41Z,use_quota=True,user_id='0d9676ef4670448292ff9efbed9bb335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Creating volume bf6180bd-b162-4f19-a950-335ffa0051f8 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:44 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d0f672-d76b-48d8-816d-b693111cf514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b886f6c0-b8f7-45f4-843a-69c2c3bf6d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:44 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 1073741824
Sep 06 17:17:44 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:44 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Volume volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d (7c4674ee-299c-4363-b5f7-bd45074c1c7d): created successfully
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b886f6c0-b8f7-45f4-843a-69c2c3bf6d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Flow 'volume_create_manager' (3ebad774-c4a5-4357-b648-acc1b5956e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:44 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-205fa510-f0bc-4407-a384-2f0e7fb5bad4 tempest-CinderUnicodeTest-39425226 None] Created volume successfully.
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-c9edb9b5-3477-43ad-8627-611523998953-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-c9edb9b5-3477-43ad-8627-611523998953-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-quobyte-c9edb9b5-3477-43ad-8627-611523998953" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-c9edb9b5-3477-43ad-8627-611523998953" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc86ab9f-2255-4e94-b27f-16eb662670ce]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:44 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953
Sep 06 17:17:44 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Flow 'volume_create_manager' (291b4899-0074-48f7-949f-23f5b5fcfe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59cdfd2-a633-45c4-a582-fe5b9460c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:44 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f59cdfd2-a633-45c4-a582-fe5b9460c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781519428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2393a09d-2cd4-4077-a8ba-e051ad4f4a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972144ef94df4bdabecc360681d04eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:45Z,use_quota=True,user_id='90100477414b42418185d9500bb03e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5cac18-1488-4ea1-bfe7-94b3f3c6d1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5cac18-1488-4ea1-bfe7-94b3f3c6d1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bf3759-0d24-4a8f-b131-c6886214bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bf3759-0d24-4a8f-b131-c6886214bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2393a09d-2cd4-4077-a8ba-e051ad4f4a22', 'volume_name': 'volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102a82ee-ed40-40f5-9ee2-ed0d411139db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102a82ee-ed40-40f5-9ee2-ed0d411139db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a5c43f-9d17-492b-882a-1929461738f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:44 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Volume 2393a09d-2cd4-4077-a8ba-e051ad4f4a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22', 'volume_size': 1}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 1073741824" returned: 0 in 0.592s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:44 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8
Sep 06 17:17:44 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:44 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:44 devstack sudo[106061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953
Sep 06 17:17:44 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:44 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8" returned: 0 in 0.278s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.317s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781519428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2393a09d-2cd4-4077-a8ba-e051ad4f4a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972144ef94df4bdabecc360681d04eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:45Z,use_quota=True,user_id='90100477414b42418185d9500bb03e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Creating volume 2393a09d-2cd4-4077-a8ba-e051ad4f4a22 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:45 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:45 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22 1073741824
Sep 06 17:17:45 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Attempting download of 3d37470d-1dbc-429b-b17f-b6acfe53d1a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'metadata': {}}])) to volume bf6180bd-b162-4f19-a950-335ffa0051f8. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ddb7c6-c2bf-4adf-b031-ba042489c05b]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_px1ayods {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:45 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c9edb9b5-3477-43ad-8627-611523998953" returned: 0 in 0.295s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-c9edb9b5-3477-43ad-8627-611523998953" released by "delete_volume" :: held 0.716s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created reservations ['01af5560-7a10-4ada-b570-ef36699ff6fc', '95a9ead3-ba7f-4fb3-b476-e01f1a1dd210', '2d153b29-ba58-4b6b-82e8-6daec78d9633', '5e864f89-37f9-45e2-945b-5474559b9b1c'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:45 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_px1ayods
Sep 06 17:17:45 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:45 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:45 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:45 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_px1ayods" returned: 0 in 0.457s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_px1ayods {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:45 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:45 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-quobyte-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22 1073741824" returned: 0 in 0.690s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.373s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:45 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_px1ayods
Sep 06 17:17:45 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Deleted volume successfully.
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[775d5c53-b944-4a92-8422-7d12e947d8ee]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e07cc36d-de16-4125-969a-b4f8f6993a14 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-c9edb9b5-3477-43ad-8627-611523998953-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:45 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22
Sep 06 17:17:45 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:45 devstack sudo[106080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83
Sep 06 17:17:45 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:45 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_px1ayods" returned: 1 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_px1ayods' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[18517ac6-3f78-4855-b347-56f24ed2cd26]: (4, 'raw') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:46 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD
Sep 06 17:17:46 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:46 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22" returned: 0 in 0.267s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.666s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a5c43f-9d17-492b-882a-1929461738f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce220f6-d9f2-4da1-a65d-a7837ae63cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Creating offline snapshot e2180aef-ae48-4192-a8c2-b4c86d25883e of volume 7c4674ee-299c-4363-b5f7-bd45074c1c7d {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:17:46 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Volume volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22 (2393a09d-2cd4-4077-a8ba-e051ad4f4a22): created successfully
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce220f6-d9f2-4da1-a65d-a7837ae63cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Flow 'volume_create_manager' (291b4899-0074-48f7-949f-23f5b5fcfe02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[28126e32-6cae-4251-94b5-cbbd4318fcad]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:46 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6d2cdea8-d4a5-4777-b671-05a40668d67e tempest-ProjectReaderTests-1311792641 None] Created volume successfully.
Sep 06 17:17:46 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83" returned: 0 in 0.378s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:46 devstack sudo[106093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83
Sep 06 17:17:46 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:46 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d
Sep 06 17:17:46 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:46 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:46 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:46 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD
Sep 06 17:17:46 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83" released by "delete_volume" :: held 0.692s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created reservations ['99ab1428-060c-4800-b7d2-39294fb97071', 'd7df7e32-c9bc-415a-ae53-a9c5e339e19a', '59d48b02-24b2-403a-92c5-0377a0bd6040', '85bc8971-d73b-44e5-9e06-e9e98f853a1f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:46 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d" returned: 0 in 0.398s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:46 devstack sudo[106105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e 1G
Sep 06 17:17:46 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:46 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:46 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:46 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] 3d37470d-1dbc-429b-b17f-b6acfe53d1a9 was raw, converting to qcow2 {{(pid=87474) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:46 devstack sudo[106112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8
Sep 06 17:17:46 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-57374485-3cd6-4c47-abb3-b9c434772be2-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-57374485-3cd6-4c47-abb3-b9c434772be2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Acquiring lock "cinder-2393a09d-2cd4-4077-a8ba-e051ad4f4a22-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Lock "cinder-2393a09d-2cd4-4077-a8ba-e051ad4f4a22-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "cinder-quobyte-57374485-3cd6-4c47-abb3-b9c434772be2" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-57374485-3cd6-4c47-abb3-b9c434772be2" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc74f23-f10f-469c-afaa-360fce1fb79d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:47 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.460s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Acquiring lock "cinder-quobyte-2393a09d-2cd4-4077-a8ba-e051ad4f4a22" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:47 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Deleted volume successfully.
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Lock "cinder-quobyte-2393a09d-2cd4-4077-a8ba-e051ad4f4a22" acquired by "delete_volume" :: waited 0.031s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-16bf0160-3944-4f24-9291-e2ebeb65d713 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-0417f4bc-bab5-4fa6-9be2-b4ff195c5e83-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d1ce50-65d2-40bf-8d5d-fe1a5f5f7d49]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:47 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2
Sep 06 17:17:47 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:47 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e 1G" returned: 0 in 0.612s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:47 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e
Sep 06 17:17:47 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:47 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22
Sep 06 17:17:47 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:47 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8" returned: 0 in 0.661s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d37470d-1dbc-429b-b17f-b6acfe53d1a9_btsnh2yfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:17:47 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Converted 0.00 MB image at 0.00 MB/s
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:47 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2" returned: 0 in 0.405s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:47 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 1G
Sep 06 17:17:47 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:47 devstack sudo[106136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2
Sep 06 17:17:47 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:47 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e" returned: 0 in 0.361s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e is being set with open permissions: ugo+rw
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:47 devstack sudo[106142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e
Sep 06 17:17:47 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:47 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22" returned: 0 in 0.440s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:47 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22
Sep 06 17:17:47 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:47 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-57374485-3cd6-4c47-abb3-b9c434772be2" returned: 0 in 0.273s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-quobyte-57374485-3cd6-4c47-abb3-b9c434772be2" released by "delete_volume" :: held 0.725s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:47 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 1G" returned: 0 in 0.362s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Downloaded image 3d37470d-1dbc-429b-b17f-b6acfe53d1a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'metadata': {}}])) to volume bf6180bd-b162-4f19-a950-335ffa0051f8 successfully. {{(pid=87474) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Temporary image 3d37470d-1dbc-429b-b17f-b6acfe53d1a9 for user 0d9676ef4670448292ff9efbed9bb335 is deleted. {{(pid=87474) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.volume_utils [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Marking volume bf6180bd-b162-4f19-a950-335ffa0051f8 as bootable. {{(pid=87474) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Created reservations ['1c71aa52-5cfd-487e-9c0f-50b0f5a4b41d', '6a2a956a-47c9-4b9a-817e-d96646a38f88', 'b324d0a1-c6db-48df-86bf-a3eb31172969', '2680026c-f9db-4eee-aa5e-440ecebca0fb'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Copying metadata from image 3d37470d-1dbc-429b-b17f-b6acfe53d1a9 to bf6180bd-b162-4f19-a950-335ffa0051f8. {{(pid=87474) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Creating volume glance metadata for volume bf6180bd-b162-4f19-a950-335ffa0051f8 backed by image 3d37470d-1dbc-429b-b17f-b6acfe53d1a9 with: {'image_id': '3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a0c1e0182a2609b21a5648a42bae92db', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87474) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 06 17:17:47 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e" returned: 0 in 0.300s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-2393a09d-2cd4-4077-a8ba-e051ad4f4a22" returned: 0 in 0.306s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Lock "cinder-quobyte-2393a09d-2cd4-4077-a8ba-e051ad4f4a22" released by "delete_volume" :: held 0.803s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:47 devstack sudo[106153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.info
Sep 06 17:17:47 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:47 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:47 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb02263-3e39-4afa-9e36-d7d650ae40a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6180bd-b162-4f19-a950-335ffa0051f8', 'volume_size': 1, 'image_id': '3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a0c1e0182a2609b21a5648a42bae92db', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d5b468d51664030a53fe762976c211a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'df1d8be171b360d5e14a64dc28e45939ce43a5cb7b9a6b1fd755cff98eb370da453c221055123be41e51c1625b6163de35346a925cacf69740e461380f5bf1f4', 'id': '3d37470d-1dbc-429b-b17f-b6acfe53d1a9', 'created_at': datetime.datetime(2026, 9, 6, 15, 17, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 15, 17, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d37470d-1dbc-429b-b17f-b6acfe53d1a9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x779ffe84be00>}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2934737a-97e2-465c-accc-23da5ab95224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:47 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Volume volume-bf6180bd-b162-4f19-a950-335ffa0051f8 (bf6180bd-b162-4f19-a950-335ffa0051f8): created successfully
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2934737a-97e2-465c-accc-23da5ab95224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Flow 'volume_create_manager' (23db6099-7a52-466c-b61e-3f8d44b4b26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8bc68eac-35fe-4d6e-a53f-3857a9e56e67 tempest-VolumeImageDependencyTests-103808444 None] Created volume successfully.
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Created reservations ['7ff15a9f-5d3e-4dc3-a416-501b779532d7', '0f3cb9b5-ffd7-4643-bc7a-2f76944a26bb', '4d2fecb1-1751-47d4-ae39-e83dd4b20362', 'ff32e0eb-7622-43fc-ba7c-6459afb32bb7'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:48 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:48 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:48 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.info" returned: 0 in 0.324s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:48 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.info is being set with open permissions: ugo+rw
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:48 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.info
Sep 06 17:17:48 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:48 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.338s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Deleted volume successfully.
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-727d5466-c47a-4321-9a7f-1560b0e380c0 tempest-CreateVolumesFromSourceVolumeTest-333698267 None] Lock "cinder-57374485-3cd6-4c47-abb3-b9c434772be2-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:48 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.282s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Deleted volume successfully.
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-cef28dde-4179-47db-872f-e6866b4445c6 tempest-ProjectReaderTests-1311792641 None] Lock "cinder-2393a09d-2cd4-4077-a8ba-e051ad4f4a22-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:48 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.info" returned: 0 in 0.294s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0dbf14bd-5765-400f-9383-c7d9ee2cc774 tempest-CinderUnicodeTest-39425226 None] Create snapshot completed successfully
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Acquiring lock "cinder-bf6180bd-b162-4f19-a950-335ffa0051f8-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Lock "cinder-bf6180bd-b162-4f19-a950-335ffa0051f8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Acquiring lock "cinder-quobyte-bf6180bd-b162-4f19-a950-335ffa0051f8" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Lock "cinder-quobyte-bf6180bd-b162-4f19-a950-335ffa0051f8" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdb36a8-cd96-4ec9-901e-cf38b0bdf898]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:49 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8
Sep 06 17:17:49 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:49 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8" returned: 0 in 0.430s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:49 devstack sudo[106171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8
Sep 06 17:17:49 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Acquiring lock "cinder-e2180aef-ae48-4192-a8c2-b4c86d25883e-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Lock "cinder-e2180aef-ae48-4192-a8c2-b4c86d25883e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Acquiring lock "cinder-quobyte-7c4674ee-299c-4363-b5f7-bd45074c1c7d" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Lock "cinder-quobyte-7c4674ee-299c-4363-b5f7-bd45074c1c7d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Acquiring lock "cinder-quobyte-e2180aef-ae48-4192-a8c2-b4c86d25883e" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Lock "cinder-quobyte-e2180aef-ae48-4192-a8c2-b4c86d25883e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Deleting offline snapshot e2180aef-ae48-4192-a8c2-b4c86d25883e of volume 7c4674ee-299c-4363-b5f7-bd45074c1c7d {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] snapshot_file for this snap is: volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[d051d1dc-ecde-4c28-85e5-1f7df0464e89]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:49 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:49 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e
Sep 06 17:17:49 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bf6180bd-b162-4f19-a950-335ffa0051f8" returned: 0 in 0.322s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:49 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Lock "cinder-quobyte-bf6180bd-b162-4f19-a950-335ffa0051f8" released by "delete_volume" :: held 0.803s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Created reservations ['cfd15306-2d6a-41ca-b470-dded1bb81bea', 'a9d8d8c3-009c-41e5-8b10-e6136595ad7a', '7ea3785a-3c24-4e81-8be8-1fc4923fc14f', 'd635f466-6d2a-4759-9cfe-4e4a6ef38ee3'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:50 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:50 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:50 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e" returned: 0 in 0.524s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[d358d2db-c59a-4c59-ace7-65202aaeafa4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:50 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.437s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:50 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d
Sep 06 17:17:50 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:50 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Deleted volume successfully.
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1b212b28-dc7d-4b0a-99ca-179d857627a9 tempest-VolumeImageDependencyTests-103808444 None] Lock "cinder-bf6180bd-b162-4f19-a950-335ffa0051f8-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:50 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d" returned: 0 in 0.607s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:51 devstack sudo[106188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e
Sep 06 17:17:51 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:51 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e" returned: 0 in 0.484s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:51 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e
Sep 06 17:17:51 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:51 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d.e2180aef-ae48-4192-a8c2-b4c86d25883e" returned: 0 in 0.317s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Lock "cinder-quobyte-e2180aef-ae48-4192-a8c2-b4c86d25883e" released by "_delete_snapshot" :: held 2.098s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Lock "cinder-quobyte-7c4674ee-299c-4363-b5f7-bd45074c1c7d" released by "delete_snapshot" :: held 2.131s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:51 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Created reservations ['7d9ea16a-f3ff-43ba-a733-2975ec86238f', '4f8d98cd-74af-4b1c-af53-621cf747036d', '5141bbdd-a9aa-44b5-9ac3-8ea6e21082fa', 'd0b82844-38e4-4b4c-ac4d-383ccfc49454'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:52 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Delete snapshot completed successfully.
Sep 06 17:17:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ddfbc1ac-4a33-4be4-8da8-8d212a353d0f tempest-CinderUnicodeTest-39425226 None] Lock "cinder-e2180aef-ae48-4192-a8c2-b4c86d25883e-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Acquiring lock "cinder-7c4674ee-299c-4363-b5f7-bd45074c1c7d-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Lock "cinder-7c4674ee-299c-4363-b5f7-bd45074c1c7d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=206,cinder:UPDATE=288,cinder:DELETE=24,cinder:INSERT=77 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Acquiring lock "cinder-quobyte-7c4674ee-299c-4363-b5f7-bd45074c1c7d" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Lock "cinder-quobyte-7c4674ee-299c-4363-b5f7-bd45074c1c7d" acquired by "delete_volume" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[020a0f5c-91ba-40c3-ac9f-859cb874b704]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:53 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d
Sep 06 17:17:53 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:53 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d" returned: 0 in 0.410s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:53 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d
Sep 06 17:17:53 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:53 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-7c4674ee-299c-4363-b5f7-bd45074c1c7d" returned: 0 in 0.304s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Lock "cinder-quobyte-7c4674ee-299c-4363-b5f7-bd45074c1c7d" released by "delete_volume" :: held 0.788s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:53 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Created reservations ['4350d5e7-197b-4d4f-8555-6be433d20f18', '317fbccc-e482-4b37-bada-c6ccca111d48', 'dffb598a-8bfe-4ccd-89f4-49d9f45f0645', '265754c7-39dd-40fb-878d-0deae206499f'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:54 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:54 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Acquiring lock "cinder-ce82990f-2a0f-40da-861b-29d97c47f6b1-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Lock "cinder-ce82990f-2a0f-40da-861b-29d97c47f6b1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Acquiring lock "cinder-quobyte-ce82990f-2a0f-40da-861b-29d97c47f6b1" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Lock "cinder-quobyte-ce82990f-2a0f-40da-861b-29d97c47f6b1" acquired by "delete_volume" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec1fc0c-90d3-43cf-8aaf-f6344486f7d9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:54 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.443s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Deleted volume successfully.
Sep 06 17:17:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-48ebffbe-93b8-4e40-bc3e-0aa892fe50cf tempest-CinderUnicodeTest-39425226 None] Lock "cinder-7c4674ee-299c-4363-b5f7-bd45074c1c7d-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:54 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1
Sep 06 17:17:54 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:55 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1" returned: 0 in 0.553s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:55 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1
Sep 06 17:17:55 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:17:55 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (aa3e1a25-2938-4067-96ea-48c0f04610f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bcd241-22b0-4bcb-90fa-ca8ae9936dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ce82990f-2a0f-40da-861b-29d97c47f6b1" returned: 0 in 0.419s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bcd241-22b0-4bcb-90fa-ca8ae9936dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667280925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4622a02-cff0-47ba-b01b-cad7d5fe0d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:55Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb845571-9fa0-4b7f-8c7e-9aa3c0f1716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb845571-9fa0-4b7f-8c7e-9aa3c0f1716b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbec8b25-1336-4c4a-ac66-bed2d850a718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbec8b25-1336-4c4a-ac66-bed2d850a718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4622a02-cff0-47ba-b01b-cad7d5fe0d1b', 'volume_name': 'volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ead884f-2743-4be8-8a04-7f0610babcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ead884f-2743-4be8-8a04-7f0610babcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f44ff-72ba-4357-bc66-3e09858da881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:55 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Volume f4622a02-cff0-47ba-b01b-cad7d5fe0d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b', 'volume_size': 1}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667280925',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4622a02-cff0-47ba-b01b-cad7d5fe0d1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:17:55Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Creating volume f4622a02-cff0-47ba-b01b-cad7d5fe0d1b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:17:55 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Lock "cinder-quobyte-ce82990f-2a0f-40da-861b-29d97c47f6b1" released by "delete_volume" :: held 1.130s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:55 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b 1073741824
Sep 06 17:17:55 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Created reservations ['f6cb5d41-5f21-4d03-94fe-1fe9be5ea1d3', '421339df-5295-475d-8ac0-e3c6b0a8ef40', '98fa59e4-8083-4fb0-80b2-e7abee59e930', 'c5db52b5-6186-4a27-a6d4-0f40943a274c'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:55 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:17:55 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:55 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.255s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:17:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Deleted volume successfully.
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f65c4aca-8bfa-43db-8fb5-14d138a60204 tempest-CinderUnicodeTest-39425226 None] Lock "cinder-ce82990f-2a0f-40da-861b-29d97c47f6b1-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:17:56 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b 1073741824" returned: 0 in 0.540s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:56 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b
Sep 06 17:17:56 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:56 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932f44ff-72ba-4357-bc66-3e09858da881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100ef67f-91ec-4b3c-bc5f-eaa14d66b0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:17:56 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Volume volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b (f4622a02-cff0-47ba-b01b-cad7d5fe0d1b): created successfully
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100ef67f-91ec-4b3c-bc5f-eaa14d66b0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:17:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (aa3e1a25-2938-4067-96ea-48c0f04610f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:17:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0ed89bc3-702c-4f8c-91e2-21750dbd7706 tempest-ProjectMemberTests-218987786 None] Created volume successfully.
Sep 06 17:17:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:17:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:17:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Creating offline snapshot fa275481-38ef-428f-b924-fde54807eebe of volume f4622a02-cff0-47ba-b01b-cad7d5fe0d1b {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:17:58 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b8f233-f722-4073-9edc-202ad06b5452]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:17:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:58 devstack sudo[106230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b
Sep 06 17:17:58 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:58 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" returned: 0 in 0.550s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:58 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe 1G
Sep 06 17:17:58 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:59 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe 1G" returned: 0 in 0.574s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:59 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe
Sep 06 17:17:59 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:17:59 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Sep 06 17:17:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe" returned: 0 in 0.405s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:17:59 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe is being set with open permissions: ugo+rw
Sep 06 17:17:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:17:59 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe
Sep 06 17:17:59 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:00 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe" returned: 0 in 0.485s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:00 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.info
Sep 06 17:18:00 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:00 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.info" returned: 0 in 0.493s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:00 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.info is being set with open permissions: ugo+rw
Sep 06 17:18:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:00 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.info
Sep 06 17:18:00 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:01 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.info" returned: 0 in 0.358s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:01 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-97b6ef99-5244-4141-96ad-4836431b8f54 tempest-ProjectMemberTests-218987786 None] Create snapshot completed successfully
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-fa275481-38ef-428f-b924-fde54807eebe-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Lock "cinder-fa275481-38ef-428f-b924-fde54807eebe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-fa275481-38ef-428f-b924-fde54807eebe" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-fa275481-38ef-428f-b924-fde54807eebe" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Deleting offline snapshot fa275481-38ef-428f-b924-fde54807eebe of volume f4622a02-cff0-47ba-b01b-cad7d5fe0d1b {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] snapshot_file for this snap is: volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ece97fd-3610-4eaf-9346-f389a11e2151]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-2f1214b2-ba01-4e4b-9aad-0a0c2d7a88e0 tempest-ProjectAdminTests-1700995429 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6612968444824, 'free_capacity_gb': 1773.6612968444824, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87474) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 06 17:18:01 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe
Sep 06 17:18:01 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:01 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe" returned: 0 in 0.485s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4956f5-9544-42de-bd85-d17bed841864]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:02 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b
Sep 06 17:18:02 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:02 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" returned: 0 in 0.444s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:02 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe
Sep 06 17:18:02 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:02 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe" returned: 0 in 0.500s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:02 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe
Sep 06 17:18:02 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:03 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b.fa275481-38ef-428f-b924-fde54807eebe" returned: 0 in 0.359s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:03 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=223,cinder:UPDATE=305,cinder:INSERT=79,cinder:DELETE=28 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:18:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-fa275481-38ef-428f-b924-fde54807eebe" released by "_delete_snapshot" :: held 1.963s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" released by "delete_snapshot" :: held 1.992s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:03 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Created reservations ['26d7c6f9-3e6a-40f8-8535-c4c4807a809c', '03f0ef9f-7bb8-4f2c-804a-e96602045383', '83c5f1ed-be3a-4ed9-b196-5e259024cb68', 'f120ec98-54f7-401b-8ebc-2531d14fbb06'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:03 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Delete snapshot completed successfully.
Sep 06 17:18:03 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44e9ce59-752e-4997-94ae-3517e738a992 tempest-ProjectMemberTests-218987786 None] Lock "cinder-fa275481-38ef-428f-b924-fde54807eebe-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:04 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" acquired by "delete_volume" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:04 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[97159572-253f-4e45-ac55-488d2b506254]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:05 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b
Sep 06 17:18:05 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:05 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" returned: 0 in 0.454s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:05 devstack sudo[106317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b
Sep 06 17:18:05 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:05 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" returned: 0 in 0.351s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b" released by "delete_volume" :: held 0.927s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:05 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Created reservations ['b509508f-fb25-48ab-bfe4-92442c914da7', 'f95cbe9a-0194-4b41-ac70-5b0c1cc9ceac', 'd59cc6bd-bcda-4afc-a533-7d0e230e55f2', 'c31e0f73-ed49-41b7-b648-a5aac72124e1'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:06 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:06 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:06 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.349s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:06 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:06 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Deleted volume successfully.
Sep 06 17:18:06 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-44393fb8-ebd7-4c4f-b6fa-a97a3fd14fa7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-f4622a02-cff0-47ba-b01b-cad7d5fe0d1b-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (83a835e3-44d8-49de-8ab0-bc3bfdc36168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2adb447-a64a-4f30-857e-76873bb79969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2adb447-a64a-4f30-857e-76873bb79969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937496741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151c3317-00dd-4fe9-9356-2c4b5c2ce0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:08Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2521d7ef-132d-44a1-bbee-15bce1166815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2521d7ef-132d-44a1-bbee-15bce1166815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d758ef-703b-449f-849e-0e28f99d1d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d758ef-703b-449f-849e-0e28f99d1d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '151c3317-00dd-4fe9-9356-2c4b5c2ce0cf', 'volume_name': 'volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2922b68-025b-4356-be29-ed4271295c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2922b68-025b-4356-be29-ed4271295c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f1bc38-5140-4bc2-902d-874e5b631693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:07 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Volume 151c3317-00dd-4fe9-9356-2c4b5c2ce0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf', 'volume_size': 1}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937496741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=151c3317-00dd-4fe9-9356-2c4b5c2ce0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:08Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Creating volume 151c3317-00dd-4fe9-9356-2c4b5c2ce0cf {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:07 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:07 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf 1073741824
Sep 06 17:18:07 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:08 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf 1073741824" returned: 0 in 0.573s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:08 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf
Sep 06 17:18:08 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:08 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" returned: 0 in 0.285s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90f1bc38-5140-4bc2-902d-874e5b631693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd22847-8fc0-454b-92aa-df37147f623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:08 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Volume volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf (151c3317-00dd-4fe9-9356-2c4b5c2ce0cf): created successfully
Sep 06 17:18:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd22847-8fc0-454b-92aa-df37147f623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:08 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (83a835e3-44d8-49de-8ab0-bc3bfdc36168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:08 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8aa6d267-8050-435d-874d-8d369899ad27 tempest-ProjectMemberTests-218987786 None] Created volume successfully.
Sep 06 17:18:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Creating offline snapshot 78d9a0f3-fb7c-48ca-9645-f244a9d53047 of volume 151c3317-00dd-4fe9-9356-2c4b5c2ce0cf {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:18:09 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[203d7b74-4b96-439a-9b5a-1a21f074e316]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:10 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf
Sep 06 17:18:10 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:10 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" returned: 0 in 0.426s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:10 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 1G
Sep 06 17:18:10 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:11 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 1G" returned: 0 in 0.702s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:11 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047
Sep 06 17:18:11 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:11 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047" returned: 0 in 0.484s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:11 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 is being set with open permissions: ugo+rw
Sep 06 17:18:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:11 devstack sudo[106348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047
Sep 06 17:18:11 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:12 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047" returned: 0 in 0.420s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:12 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.info
Sep 06 17:18:12 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:12 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.info" returned: 0 in 0.373s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:12 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.info is being set with open permissions: ugo+rw
Sep 06 17:18:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:12 devstack sudo[106355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.info
Sep 06 17:18:12 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:12 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.info" returned: 0 in 0.323s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.838s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-93660a45-610a-49b5-ba3f-253d5bd74bea tempest-ProjectMemberTests-218987786 None] Create snapshot completed successfully
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-78d9a0f3-fb7c-48ca-9645-f244a9d53047-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-78d9a0f3-fb7c-48ca-9645-f244a9d53047-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-78d9a0f3-fb7c-48ca-9645-f244a9d53047" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-78d9a0f3-fb7c-48ca-9645-f244a9d53047" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Deleting offline snapshot 78d9a0f3-fb7c-48ca-9645-f244a9d53047 of volume 151c3317-00dd-4fe9-9356-2c4b5c2ce0cf {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] snapshot_file for this snap is: volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e132781-5782-49a5-b099-986d6b517bb2]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:13 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047
Sep 06 17:18:13 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:13 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047" returned: 0 in 0.446s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c42426-b889-4305-bc07-c0d80589e455]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:13 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf
Sep 06 17:18:13 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:14 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" returned: 0 in 0.426s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:14 devstack sudo[106369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047
Sep 06 17:18:14 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:14 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047" returned: 0 in 0.398s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:14 devstack sudo[106375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047
Sep 06 17:18:14 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:14 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf.78d9a0f3-fb7c-48ca-9645-f244a9d53047" returned: 0 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-78d9a0f3-fb7c-48ca-9645-f244a9d53047" released by "_delete_snapshot" :: held 1.783s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" released by "delete_snapshot" :: held 1.813s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Created reservations ['0801c7dc-8c7f-48ee-880f-bf63d3bc4799', '012fd41f-f6da-445e-baaf-f56edf1ed2ec', '309827f1-a629-4e9c-865e-c445b9607317', 'eb275509-f947-4fc9-bbfe-d0bf88b9408e'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:15 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Delete snapshot completed successfully.
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-1e06bb1f-f8af-4d5b-82f8-7b9b04ee7ac7 tempest-ProjectMemberTests-218987786 None] Lock "cinder-78d9a0f3-fb7c-48ca-9645-f244a9d53047-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Lock "cinder-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdae78e9-9f52-4507-ab19-b82d069be0d5]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:15 devstack sudo[106378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf
Sep 06 17:18:15 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:15 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" returned: 0 in 0.429s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:15 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf
Sep 06 17:18:16 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:16 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf" released by "delete_volume" :: held 0.753s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Created reservations ['004e48d7-1558-4caf-b0be-3b31e55d4f6e', 'cbfc28b0-b53b-4426-84ae-a454e81540b3', 'b3d17ec1-bedf-4d47-801e-6b96ab7aaf8c', '8be6d48e-4ba9-4534-bbc8-8df9e2669a5c'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:16 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:16 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:16 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.399s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Deleted volume successfully.
Sep 06 17:18:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-51ea52c0-cd8a-428f-becb-74951c2090f5 tempest-ProjectMemberTests-218987786 None] Lock "cinder-151c3317-00dd-4fe9-9356-2c4b5c2ce0cf-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (b888bfde-c51c-4c8c-b385-45523ccf53d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6457a3b5-c0c2-43b7-a8bd-dc5942d76fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6457a3b5-c0c2-43b7-a8bd-dc5942d76fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269051107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96799e2-b149-4066-95b2-d85ed4b47b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:17Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de1e8d8-a0fe-4eb7-be3b-2be9b3933d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de1e8d8-a0fe-4eb7-be3b-2be9b3933d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb49742-85ae-42f5-95f7-45a59f397850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb49742-85ae-42f5-95f7-45a59f397850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96799e2-b149-4066-95b2-d85ed4b47b60', 'volume_name': 'volume-b96799e2-b149-4066-95b2-d85ed4b47b60', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fc73c0-03d7-4601-839f-cb166eb69d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fc73c0-03d7-4601-839f-cb166eb69d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe1c11b-cfcd-489c-a4b8-2787c7f7eefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Volume b96799e2-b149-4066-95b2-d85ed4b47b60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96799e2-b149-4066-95b2-d85ed4b47b60', 'volume_size': 1}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269051107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96799e2-b149-4066-95b2-d85ed4b47b60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:17Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Creating volume b96799e2-b149-4066-95b2-d85ed4b47b60 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:17 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:17 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60 1073741824
Sep 06 17:18:17 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:17 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60 1073741824" returned: 0 in 0.537s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:17 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60
Sep 06 17:18:17 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Flow 'volume_create_manager' (c4b0c7ae-34ad-4d21-9525-df50bb6acc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ed0d26-2ebd-4e2f-a7be-0c4ea4eec423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ed0d26-2ebd-4e2f-a7be-0c4ea4eec423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118053671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd22bc44-2651-498f-a6d6-663fe4ebba3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f96b3c5f944d119f73bbe83a96bb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:18Z,use_quota=True,user_id='9874b3bac7ce45a388224f71a7973bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4142e3d9-1b6e-439b-829e-e1006b953857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4142e3d9-1b6e-439b-829e-e1006b953857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7db97fb-5953-4dea-9592-98df776a10fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7db97fb-5953-4dea-9592-98df776a10fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd22bc44-2651-498f-a6d6-663fe4ebba3f', 'volume_name': 'volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0f171f-53d6-4662-aaf7-8c3ad69a7ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0f171f-53d6-4662-aaf7-8c3ad69a7ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7f8b2f-c87e-47d1-9215-0f553f390444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:17 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Volume bd22bc44-2651-498f-a6d6-663fe4ebba3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f', 'volume_size': 1}
Sep 06 17:18:17 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:18 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60" returned: 0 in 0.314s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118053671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd22bc44-2651-498f-a6d6-663fe4ebba3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f96b3c5f944d119f73bbe83a96bb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:18Z,use_quota=True,user_id='9874b3bac7ce45a388224f71a7973bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Creating volume bd22bc44-2651-498f-a6d6-663fe4ebba3f {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:18 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:18 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f 1073741824
Sep 06 17:18:18 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe1c11b-cfcd-489c-a4b8-2787c7f7eefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96799e2-b149-4066-95b2-d85ed4b47b60', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef33994-2646-4e9a-936f-8ea0d76d502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:18 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Volume volume-b96799e2-b149-4066-95b2-d85ed4b47b60 (b96799e2-b149-4066-95b2-d85ed4b47b60): created successfully
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef33994-2646-4e9a-936f-8ea0d76d502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (b888bfde-c51c-4c8c-b385-45523ccf53d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-853f739a-ff85-443a-98bd-d88f0f5c429b tempest-ProjectMemberTests-218987786 None] Created volume successfully.
Sep 06 17:18:18 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f 1073741824" returned: 0 in 0.476s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:18 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f
Sep 06 17:18:18 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:18 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f" returned: 0 in 0.278s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7f8b2f-c87e-47d1-9215-0f553f390444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228a8023-5a10-4336-94e2-b7951944f633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:18 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Volume volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f (bd22bc44-2651-498f-a6d6-663fe4ebba3f): created successfully
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228a8023-5a10-4336-94e2-b7951944f633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:18 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Flow 'volume_create_manager' (c4b0c7ae-34ad-4d21-9525-df50bb6acc10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:18 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8ef8a100-8a3d-4bc7-bcce-8d84dc69fc33 tempest-ProjectReaderTests-65237529 None] Created volume successfully.
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Creating offline snapshot 5368feca-fde4-4caf-bcf2-3a22d4c155ee of volume b96799e2-b149-4066-95b2-d85ed4b47b60 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7235abf1-5c70-434e-bf84-4ae751652d32]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Flow 'volume_create_manager' (d1b17d95-1445-4e94-9a94-3dd5f1b4442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be4b664-1999-45e6-b6a9-551036d88d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be4b664-1999-45e6-b6a9-551036d88d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1461480542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5669fff-0f30-4ca6-a3e3-3f4814e30dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202a7fdd323a456e878eee8a52c7ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:20Z,use_quota=True,user_id='090bc33839c44c7f90e5a63b8edfec5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f58ba0e-79ff-4fab-9452-8db3cb64d778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f58ba0e-79ff-4fab-9452-8db3cb64d778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ef647a-a406-40cd-a428-098b309a444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ef647a-a406-40cd-a428-098b309a444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5669fff-0f30-4ca6-a3e3-3f4814e30dc5', 'volume_name': 'volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce637eb5-94a6-4bbe-9cf7-76e671008a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce637eb5-94a6-4bbe-9cf7-76e671008a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3b9d4e-ee01-487b-ab25-00285541c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:19 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Volume c5669fff-0f30-4ca6-a3e3-3f4814e30dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5', 'volume_size': 1}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:19 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60
Sep 06 17:18:19 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:19 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60" returned: 0 in 0.366s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:19 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee 1G
Sep 06 17:18:19 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Acquiring lock "cinder-bd22bc44-2651-498f-a6d6-663fe4ebba3f-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Lock "cinder-bd22bc44-2651-498f-a6d6-663fe4ebba3f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Acquiring lock "cinder-quobyte-bd22bc44-2651-498f-a6d6-663fe4ebba3f" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Lock "cinder-quobyte-bd22bc44-2651-498f-a6d6-663fe4ebba3f" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d1aa0c-9a62-4823-a525-5f9ea556694f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:20 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:20 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f
Sep 06 17:18:20 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee 1G" returned: 0 in 0.406s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b96799e2-b149-4066-95b2-d85ed4b47b60 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:20 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b96799e2-b149-4066-95b2-d85ed4b47b60 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee
Sep 06 17:18:20 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:20 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:20 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f" returned: 0 in 0.404s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b96799e2-b149-4066-95b2-d85ed4b47b60 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee" returned: 0 in 0.291s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:20 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee is being set with open permissions: ugo+rw
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:20 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f
Sep 06 17:18:20 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:20 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee
Sep 06 17:18:20 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:20 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee" returned: 0 in 0.236s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:20 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-bd22bc44-2651-498f-a6d6-663fe4ebba3f" returned: 0 in 0.260s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Lock "cinder-quobyte-bd22bc44-2651-498f-a6d6-663fe4ebba3f" released by "delete_volume" :: held 0.713s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:20 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.info
Sep 06 17:18:20 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:20 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Created reservations ['3d2476dc-a726-4fe6-ae3f-6d84665ccd96', '81f7751f-abbe-47bf-9e43-0a3171a2bbbd', '4306bbf4-65cc-412b-8cc1-86283434b6e8', 'fef15ab5-bf60-4025-9175-84ef46317c00'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:21 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:21 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:21 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.info" returned: 0 in 0.253s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:21 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.info is being set with open permissions: ugo+rw
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:21 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.info
Sep 06 17:18:21 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:21 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.266s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:21 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Deleted volume successfully.
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-56443248-3dac-4f39-b1d9-aaa349bb923b tempest-ProjectReaderTests-65237529 None] Lock "cinder-bd22bc44-2651-498f-a6d6-663fe4ebba3f-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:21 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.info" returned: 0 in 0.245s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.748s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1461480542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5669fff-0f30-4ca6-a3e3-3f4814e30dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202a7fdd323a456e878eee8a52c7ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:20Z,use_quota=True,user_id='090bc33839c44c7f90e5a63b8edfec5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Creating volume c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:21 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:21 devstack sudo[106451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 1073741824
Sep 06 17:18:21 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:21 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-c138465f-89c3-46a6-b8cc-3841b408ce16 tempest-ProjectMemberTests-218987786 None] Create snapshot completed successfully
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Flow 'volume_create_manager' (e19a0faa-b6ac-4c78-8aef-8b860010fbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbc5d89-6718-426d-baad-6c8a0ac7e7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbc5d89-6718-426d-baad-6c8a0ac7e7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727260158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580b05f0-8c0d-42cd-b7e9-a09c71b0f967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f96b3c5f944d119f73bbe83a96bb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:22Z,use_quota=True,user_id='9874b3bac7ce45a388224f71a7973bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0edbd6-1bff-4c23-a47e-921b9ba3a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f0edbd6-1bff-4c23-a47e-921b9ba3a067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:21 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8e80ac-12a8-407c-8344-b5ea2fa144d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8e80ac-12a8-407c-8344-b5ea2fa144d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580b05f0-8c0d-42cd-b7e9-a09c71b0f967', 'volume_name': 'volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf43f86-4ebf-44a1-864a-8ca2bf002af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf43f86-4ebf-44a1-864a-8ca2bf002af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8bd072-ffee-45fa-b30c-0f6bf3c40ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:21 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Volume 580b05f0-8c0d-42cd-b7e9-a09c71b0f967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967', 'volume_size': 1}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 1073741824" returned: 0 in 0.453s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:21 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5
Sep 06 17:18:21 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:22 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" returned: 0 in 0.247s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727260158',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580b05f0-8c0d-42cd-b7e9-a09c71b0f967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f96b3c5f944d119f73bbe83a96bb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:22Z,use_quota=True,user_id='9874b3bac7ce45a388224f71a7973bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Creating volume 580b05f0-8c0d-42cd-b7e9-a09c71b0f967 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:22 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3b9d4e-ee01-487b-ab25-00285541c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:22 devstack sudo[106461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967 1073741824
Sep 06 17:18:22 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488c0ec5-bb61-4385-9964-aae92fdb8599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:22 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Volume volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 (c5669fff-0f30-4ca6-a3e3-3f4814e30dc5): created successfully
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (488c0ec5-bb61-4385-9964-aae92fdb8599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Flow 'volume_create_manager' (d1b17d95-1445-4e94-9a94-3dd5f1b4442d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-abab5289-73e8-496b-acee-43ec8fb6ee63 tempest-SnapshotDependencyTests-262516878 None] Created volume successfully.
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-5368feca-fde4-4caf-bcf2-3a22d4c155ee-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Lock "cinder-5368feca-fde4-4caf-bcf2-3a22d4c155ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-b96799e2-b149-4066-95b2-d85ed4b47b60" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-b96799e2-b149-4066-95b2-d85ed4b47b60" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-5368feca-fde4-4caf-bcf2-3a22d4c155ee" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:22 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967 1073741824" returned: 0 in 0.448s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-5368feca-fde4-4caf-bcf2-3a22d4c155ee" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Deleting offline snapshot 5368feca-fde4-4caf-bcf2-3a22d4c155ee of volume b96799e2-b149-4066-95b2-d85ed4b47b60 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] snapshot_file for this snap is: volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2601efec-b10a-4a17-a072-4ba13b138de9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:22 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967
Sep 06 17:18:22 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:22 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee
Sep 06 17:18:22 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:23 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967" returned: 0 in 0.314s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.078s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8bd072-ffee-45fa-b30c-0f6bf3c40ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40eec5a1-add2-479c-b589-83ed90805079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Creating offline snapshot 2917d32c-c394-4fa2-95c6-125cb2605a3f of volume c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:18:23 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee" returned: 0 in 0.389s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b96799e2-b149-4066-95b2-d85ed4b47b60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d4ad7-73b4-41a2-851a-12b1e87c3d18]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eb7a60-ce24-4fba-a071-81e5c75f7073]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:23 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Volume volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967 (580b05f0-8c0d-42cd-b7e9-a09c71b0f967): created successfully
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40eec5a1-add2-479c-b589-83ed90805079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Flow 'volume_create_manager' (e19a0faa-b6ac-4c78-8aef-8b860010fbfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:23 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5c6e19d1-aea3-4a72-b8e8-6d00cfe4e837 tempest-ProjectReaderTests-65237529 None] Created volume successfully.
Sep 06 17:18:23 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5
Sep 06 17:18:23 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:23 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60
Sep 06 17:18:23 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:23 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:23 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" returned: 0 in 0.395s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:23 devstack sudo[106485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee
Sep 06 17:18:23 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:23 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f 1G
Sep 06 17:18:23 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:23 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee" returned: 0 in 0.335s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:23 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee
Sep 06 17:18:23 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:23 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f 1G" returned: 0 in 0.395s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:23 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f
Sep 06 17:18:23 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Acquiring lock "cinder-580b05f0-8c0d-42cd-b7e9-a09c71b0f967-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Lock "cinder-580b05f0-8c0d-42cd-b7e9-a09c71b0f967-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Acquiring lock "cinder-quobyte-580b05f0-8c0d-42cd-b7e9-a09c71b0f967" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Lock "cinder-quobyte-580b05f0-8c0d-42cd-b7e9-a09c71b0f967" acquired by "delete_volume" :: waited 0.027s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[da53c462-58bf-448c-baf8-1f0eb6d36140]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:24 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60.5368feca-fde4-4caf-bcf2-3a22d4c155ee" returned: 0 in 0.294s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-5368feca-fde4-4caf-bcf2-3a22d4c155ee" released by "_delete_snapshot" :: held 1.492s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-b96799e2-b149-4066-95b2-d85ed4b47b60" released by "delete_snapshot" :: held 1.519s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Created reservations ['046f949e-044a-42c9-933b-581c7d65957f', 'e3b34440-99ee-4f55-9d8c-f1b67e88061c', 'cc681862-ea22-407e-b2fc-b201570fcee8', '53fb663b-b539-4f01-9769-d92a0702be77'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:24 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967
Sep 06 17:18:24 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:24 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f" returned: 0 in 0.355s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:24 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f is being set with open permissions: ugo+rw
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:24 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f
Sep 06 17:18:24 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Delete snapshot completed successfully.
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-aba59d35-ffc7-4438-beb1-47ca3cc57837 tempest-ProjectMemberTests-218987786 None] Lock "cinder-5368feca-fde4-4caf-bcf2-3a22d4c155ee-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:24 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:24 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967" returned: 0 in 0.385s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f" returned: 0 in 0.253s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:24 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967
Sep 06 17:18:24 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:24 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.info
Sep 06 17:18:24 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:24 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-b96799e2-b149-4066-95b2-d85ed4b47b60-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-580b05f0-8c0d-42cd-b7e9-a09c71b0f967" returned: 0 in 0.280s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Lock "cinder-quobyte-580b05f0-8c0d-42cd-b7e9-a09c71b0f967" released by "delete_volume" :: held 0.713s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Lock "cinder-b96799e2-b149-4066-95b2-d85ed4b47b60-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:24 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.info" returned: 0 in 0.291s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:24 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.info is being set with open permissions: ugo+rw
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:24 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.info
Sep 06 17:18:24 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-b96799e2-b149-4066-95b2-d85ed4b47b60" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-b96799e2-b149-4066-95b2-d85ed4b47b60" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b12fd5e-a11a-482d-bf10-734f3345ea2c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Created reservations ['0167ae46-f59a-44c4-95bf-2b2ddb336435', 'c87fedf6-b21d-4a10-87bc-8d584b9148bf', '64ef86f0-97ee-4d81-b372-2613b5b03613', '4a128cd7-0733-4f48-8ef5-04d2d4f7e5c5'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:25 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:25 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:25 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60
Sep 06 17:18:25 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:25 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.info" returned: 0 in 0.274s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.098s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:25 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ab111269-24ed-4fed-8c5d-4fc327b4a3e7 tempest-SnapshotDependencyTests-262516878 None] Create snapshot completed successfully
Sep 06 17:18:25 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:25 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Deleted volume successfully.
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4471fd0a-b463-48fa-9e59-ad3bbc9f0525 tempest-ProjectReaderTests-65237529 None] Lock "cinder-580b05f0-8c0d-42cd-b7e9-a09c71b0f967-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:25 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60" returned: 0 in 0.410s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:25 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60
Sep 06 17:18:25 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:25 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-b96799e2-b149-4066-95b2-d85ed4b47b60" returned: 0 in 0.255s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-b96799e2-b149-4066-95b2-d85ed4b47b60" released by "delete_volume" :: held 0.731s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Created reservations ['eddfb7aa-8d34-4a94-857a-d103112b6905', '76fd475d-a5e9-4522-bf86-1f44a4edef71', '2b88fc19-1476-4e78-9bf2-7ef157f7040f', '9891319d-7bb9-4854-a4b7-5e007a94f818'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Flow 'volume_create_manager' (bbf46997-847d-4b9d-bfc9-a58ce674cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e2b6c3-5ab3-4ea1-ab7a-2bec46c0ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90e2b6c3-5ab3-4ea1-ab7a-2bec46c0ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911138384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbf50e1-b401-466d-9333-0d82e686be2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f96b3c5f944d119f73bbe83a96bb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:26Z,use_quota=True,user_id='9874b3bac7ce45a388224f71a7973bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a624d69f-43e7-4783-bb8c-7f80ba0ef549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a624d69f-43e7-4783-bb8c-7f80ba0ef549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfd2716-5d29-4441-bb2a-38576154be96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfd2716-5d29-4441-bb2a-38576154be96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbf50e1-b401-466d-9333-0d82e686be2d', 'volume_name': 'volume-afbf50e1-b401-466d-9333-0d82e686be2d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9326d9a6-e4dd-4cee-b4d2-546a9b39dbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9326d9a6-e4dd-4cee-b4d2-546a9b39dbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d376c1f-735b-4f68-be9f-35aaf79d2b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:25 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Volume afbf50e1-b401-466d-9333-0d82e686be2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbf50e1-b401-466d-9333-0d82e686be2d', 'volume_size': 1}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911138384',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbf50e1-b401-466d-9333-0d82e686be2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f96b3c5f944d119f73bbe83a96bb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:26Z,use_quota=True,user_id='9874b3bac7ce45a388224f71a7973bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Creating volume afbf50e1-b401-466d-9333-0d82e686be2d {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:25 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:25 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d 1073741824
Sep 06 17:18:25 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:25 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:25 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:26 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:26 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:26 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.304s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:26 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Deleted volume successfully.
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-deee4333-9149-431e-ab70-f5e77f640e5a tempest-ProjectMemberTests-218987786 None] Lock "cinder-b96799e2-b149-4066-95b2-d85ed4b47b60-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:26 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d 1073741824" returned: 0 in 0.571s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:26 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:26 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.365s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:26 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (967e6c31-c931-41a1-a98e-092e8eaa99c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2be57c4-ec74-4073-a3b4-9472229745f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2be57c4-ec74-4073-a3b4-9472229745f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787744373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af44c567-5f5f-4391-afef-4d6f53f0a3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:26Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ceda8e2-54fb-4a3c-ac0c-3001db0f82b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ceda8e2-54fb-4a3c-ac0c-3001db0f82b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aef229-afb9-4224-aa63-7fb5b3ebf4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76aef229-afb9-4224-aa63-7fb5b3ebf4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af44c567-5f5f-4391-afef-4d6f53f0a3d0', 'volume_name': 'volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb54a20a-7f35-4f6a-b7a1-4da24c9b205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb54a20a-7f35-4f6a-b7a1-4da24c9b205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174ff858-3627-48b6-8782-9405449cde57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Volume af44c567-5f5f-4391-afef-4d6f53f0a3d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0', 'volume_size': 1}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:26 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d" returned: 0 in 0.279s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787744373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af44c567-5f5f-4391-afef-4d6f53f0a3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:26Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Creating volume af44c567-5f5f-4391-afef-4d6f53f0a3d0 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:26 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d376c1f-735b-4f68-be9f-35aaf79d2b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbf50e1-b401-466d-9333-0d82e686be2d', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 1073741824
Sep 06 17:18:26 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fcdeaa-c337-42bb-b6ed-fd39accc3a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Volume volume-afbf50e1-b401-466d-9333-0d82e686be2d (afbf50e1-b401-466d-9333-0d82e686be2d): created successfully
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fcdeaa-c337-42bb-b6ed-fd39accc3a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Flow 'volume_create_manager' (bbf46997-847d-4b9d-bfc9-a58ce674cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:26 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-abce8811-ad51-4107-9a8c-98bc8bd1d89c tempest-ProjectReaderTests-65237529 None] Created volume successfully.
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Flow 'volume_create_manager' (5addcc38-4399-4698-ba62-f0f3d504ff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7fa968-775c-4be5-b322-574566a08608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7fa968-775c-4be5-b322-574566a08608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee70b591-17e9-4412-ba69-48d85c3b3496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='202a7fdd323a456e878eee8a52c7ea82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2917d32c-c394-4fa2-95c6-125cb2605a3f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:27Z,use_quota=True,user_id='090bc33839c44c7f90e5a63b8edfec5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ce8cea-cb10-4a29-bed3-b5d4c0bb2948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ce8cea-cb10-4a29-bed3-b5d4c0bb2948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756b55e9-a19b-4ebe-af3d-bb2cd1414512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756b55e9-a19b-4ebe-af3d-bb2cd1414512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee70b591-17e9-4412-ba69-48d85c3b3496', 'volume_name': 'volume-ee70b591-17e9-4412-ba69-48d85c3b3496', 'volume_size': 1, 'snapshot_id': '2917d32c-c394-4fa2-95c6-125cb2605a3f'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9087e8-b82d-4637-9dd8-7e2c9ab44306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9087e8-b82d-4637-9dd8-7e2c9ab44306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1be2c9f-5ecb-4045-a5b9-5e160f0e1999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:26 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Volume ee70b591-17e9-4412-ba69-48d85c3b3496: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee70b591-17e9-4412-ba69-48d85c3b3496', 'volume_size': 1, 'snapshot_id': '2917d32c-c394-4fa2-95c6-125cb2605a3f'}
Sep 06 17:18:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:27 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 1073741824" returned: 0 in 0.419s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:27 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0
Sep 06 17:18:27 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:27 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.491s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "cinder-quobyte-2917d32c-c394-4fa2-95c6-125cb2605a3f-ee70b591-17e9-4412-ba69-48d85c3b3496" by "_create_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (174ff858-3627-48b6-8782-9405449cde57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3ca66b-4643-49b4-a580-5a0b2d2a1251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-2917d32c-c394-4fa2-95c6-125cb2605a3f-ee70b591-17e9-4412-ba69-48d85c3b3496" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Creating volume ee70b591-17e9-4412-ba69-48d85c3b3496 from snapshot 2917d32c-c394-4fa2-95c6-125cb2605a3f {{(pid=87474) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "cinder-quobyte-ee70b591-17e9-4412-ba69-48d85c3b3496" by "_copy_volume_from_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:27 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Volume volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 (af44c567-5f5f-4391-afef-4d6f53f0a3d0): created successfully
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3ca66b-4643-49b4-a580-5a0b2d2a1251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (967e6c31-c931-41a1-a98e-092e8eaa99c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-ee70b591-17e9-4412-ba69-48d85c3b3496" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] snapshot: 2917d32c-c394-4fa2-95c6-125cb2605a3f, volume: ee70b591-17e9-4412-ba69-48d85c3b3496,  {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 06 17:18:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-32383057-64ff-4dfc-a7e7-e1eb247ac238 tempest-ProjectMemberTests-218987786 None] Created volume successfully.
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5c0be6-bae2-497e-b3d0-e18052be7db7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:27 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f
Sep 06 17:18:27 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Acquiring lock "cinder-afbf50e1-b401-466d-9333-0d82e686be2d-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Lock "cinder-afbf50e1-b401-466d-9333-0d82e686be2d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Acquiring lock "cinder-quobyte-afbf50e1-b401-466d-9333-0d82e686be2d" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Lock "cinder-quobyte-afbf50e1-b401-466d-9333-0d82e686be2d" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:27 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f" returned: 0 in 0.373s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e41f3d0-c803-48f5-bc0e-179e68310513]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe78662-79c3-437f-be6c-6756e9f5cf63]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:28 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d
Sep 06 17:18:28 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:28 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5
Sep 06 17:18:28 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:28 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d" returned: 0 in 0.350s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:28 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" returned: 0 in 0.351s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Creating direct copy from snapshot {{(pid=87474) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG cinder.utils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Path /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496 not found in is_blk_device check {{(pid=87474) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:28 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d
Sep 06 17:18:28 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:28 devstack sudo[106576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496
Sep 06 17:18:28 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:28 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-afbf50e1-b401-466d-9333-0d82e686be2d" returned: 0 in 0.263s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Lock "cinder-quobyte-afbf50e1-b401-466d-9333-0d82e686be2d" released by "delete_volume" :: held 0.651s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Created reservations ['8c05b8d7-7b7d-4f53-8383-10e067e58f18', '7551d93b-6eb4-4f16-80bf-1dd17b030ea9', 'ac8457f6-8e10-4320-9868-997dc65bb7e3', '1c3921f7-2fe0-45c6-8c5b-06626eee7762'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:28 devstack sudo[106583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:28 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:29 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.793s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:29 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:29 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Deleted volume successfully.
Sep 06 17:18:29 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7a67269b-8cc8-41a4-bf5e-84bde68cd737 tempest-ProjectReaderTests-65237529 None] Lock "cinder-afbf50e1-b401-466d-9333-0d82e686be2d-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:29 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Flow 'volume_create_manager' (39106ed4-cf41-4b80-8992-5b8f94424670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec07aa8-3934-4a52-8849-0c62fccd2e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec07aa8-3934-4a52-8849-0c62fccd2e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059334328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d85ceb5-389a-4ca7-b26b-845023853c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f96b3c5f944d119f73bbe83a96bb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:30Z,use_quota=True,user_id='9874b3bac7ce45a388224f71a7973bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facbfcff-9edd-475d-9121-19996487bc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (facbfcff-9edd-475d-9121-19996487bc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af1c9e0-33fa-4f17-ae73-4d97a07d5101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af1c9e0-33fa-4f17-ae73-4d97a07d5101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d85ceb5-389a-4ca7-b26b-845023853c4b', 'volume_name': 'volume-4d85ceb5-389a-4ca7-b26b-845023853c4b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3f9c02-9d89-4a58-b04b-4519a49db94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3f9c02-9d89-4a58-b04b-4519a49db94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5a6aba-f92a-4f5a-8d92-991e4e26aeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:30 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Volume 4d85ceb5-389a-4ca7-b26b-845023853c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d85ceb5-389a-4ca7-b26b-845023853c4b', 'volume_size': 1}
Sep 06 17:18:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:32 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496" returned: 0 in 4.313s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG cinder.image.image_utils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5, size 1024.00 MB, duration 4.31 sec, destination /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496 {{(pid=87474) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 06 17:18:32 devstack cinder-volume[87474]: INFO cinder.image.image_utils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Converted 1024.00 MB image at 237.37 MB/s
Sep 06 17:18:32 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496 is being set with open permissions: ugo+rw
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:32 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496
Sep 06 17:18:32 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:32 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496" returned: 0 in 0.233s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-ee70b591-17e9-4412-ba69-48d85c3b3496" released by "_copy_volume_from_snapshot" :: held 5.355s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-2917d32c-c394-4fa2-95c6-125cb2605a3f-ee70b591-17e9-4412-ba69-48d85c3b3496" released by "_create_volume_from_snapshot" :: held 5.421s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.452s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.176s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Creating offline snapshot 6e4f69c3-a46f-426d-931e-ca30bd5a0d4b of volume af44c567-5f5f-4391-afef-4d6f53f0a3d0 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1be2c9f-5ecb-4045-a5b9-5e160f0e1999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee70b591-17e9-4412-ba69-48d85c3b3496', 'volume_size': 1, 'snapshot_id': '2917d32c-c394-4fa2-95c6-125cb2605a3f'}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c7e7ff-246b-4f3b-a6bb-f337a7425e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dc2428-c263-4f70-aea3-0f8731ad6a43]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:32 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Volume volume-ee70b591-17e9-4412-ba69-48d85c3b3496 (ee70b591-17e9-4412-ba69-48d85c3b3496): created successfully
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c7e7ff-246b-4f3b-a6bb-f337a7425e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:32 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Flow 'volume_create_manager' (5addcc38-4399-4698-ba62-f0f3d504ff8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:32 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-6963c7c1-7761-4e45-b490-d2d9df42bc98 tempest-SnapshotDependencyTests-262516878 None] Created volume successfully.
Sep 06 17:18:33 devstack sudo[106598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0
Sep 06 17:18:33 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:33 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0" returned: 0 in 0.348s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:33 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b 1G
Sep 06 17:18:33 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "cinder-2917d32c-c394-4fa2-95c6-125cb2605a3f-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-2917d32c-c394-4fa2-95c6-125cb2605a3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "cinder-quobyte-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "cinder-quobyte-2917d32c-c394-4fa2-95c6-125cb2605a3f" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:33 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b 1G" returned: 0 in 0.404s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-2917d32c-c394-4fa2-95c6-125cb2605a3f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Deleting offline snapshot 2917d32c-c394-4fa2-95c6-125cb2605a3f of volume c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:18:33 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b
Sep 06 17:18:33 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] snapshot_file for this snap is: volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7557fd65-57fe-4536-9ea7-aed4ff1ed9e9]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:33 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f
Sep 06 17:18:33 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:33 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:33 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b is being set with open permissions: ugo+rw
Sep 06 17:18:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:33 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b
Sep 06 17:18:33 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:34 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f14c66-7703-4b20-972b-5a4ec47e75cd]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:34 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b" returned: 0 in 0.257s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:34 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5
Sep 06 17:18:34 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:34 devstack sudo[106623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.info
Sep 06 17:18:34 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:34 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.info" returned: 0 in 0.245s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:34 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.info is being set with open permissions: ugo+rw
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:34 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.info
Sep 06 17:18:34 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:34 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" returned: 0 in 0.525s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:34 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f
Sep 06 17:18:34 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:34 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.info" returned: 0 in 0.250s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.603s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059334328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d85ceb5-389a-4ca7-b26b-845023853c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77f96b3c5f944d119f73bbe83a96bb8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:30Z,use_quota=True,user_id='9874b3bac7ce45a388224f71a7973bfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Creating volume 4d85ceb5-389a-4ca7-b26b-845023853c4b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:34 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:34 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b 1073741824
Sep 06 17:18:34 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-1711d4e9-5651-4e09-aa2a-be4227125b61 tempest-ProjectMemberTests-218987786 None] Create snapshot completed successfully
Sep 06 17:18:34 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f" returned: 0 in 0.330s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:35 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f
Sep 06 17:18:35 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-6e4f69c3-a46f-426d-931e-ca30bd5a0d4b-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Lock "cinder-6e4f69c3-a46f-426d-931e-ca30bd5a0d4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-af44c567-5f5f-4391-afef-4d6f53f0a3d0" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-af44c567-5f5f-4391-afef-4d6f53f0a3d0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-6e4f69c3-a46f-426d-931e-ca30bd5a0d4b" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-6e4f69c3-a46f-426d-931e-ca30bd5a0d4b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Deleting offline snapshot 6e4f69c3-a46f-426d-931e-ca30bd5a0d4b of volume af44c567-5f5f-4391-afef-4d6f53f0a3d0 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] snapshot_file for this snap is: volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8db79d-be30-4eb3-983e-c6b718b7ff52]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:35 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5.2917d32c-c394-4fa2-95c6-125cb2605a3f" returned: 0 in 0.279s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:35 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b 1073741824" returned: 0 in 0.549s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-2917d32c-c394-4fa2-95c6-125cb2605a3f" released by "_delete_snapshot" :: held 1.618s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" released by "delete_snapshot" :: held 1.651s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:35 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b
Sep 06 17:18:35 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:35 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b
Sep 06 17:18:35 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Created reservations ['baa2cc64-9b29-4d8d-aad9-d246326e50c6', '4aef8e2c-1355-4068-a048-ebd8e1777545', 'd1e4a194-54bd-467c-b15b-bcad04a8b14a', 'f4693e3f-42d4-4635-885a-e7ad20835f19'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Delete snapshot completed successfully.
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-5f101430-7421-4dc5-a352-70e19104a8e4 tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-2917d32c-c394-4fa2-95c6-125cb2605a3f-delete_snapshot" released by "delete_snapshot" :: held 1.822s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:35 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:35 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b" returned: 0 in 0.385s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b" returned: 0 in 0.304s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dfad15-a9ea-4ef0-a44b-0d63a739beb4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5a6aba-f92a-4f5a-8d92-991e4e26aeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d85ceb5-389a-4ca7-b26b-845023853c4b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b649479-195f-4b42-b94f-eb4836ef7741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:35 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Volume volume-4d85ceb5-389a-4ca7-b26b-845023853c4b (4d85ceb5-389a-4ca7-b26b-845023853c4b): created successfully
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b649479-195f-4b42-b94f-eb4836ef7741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Flow 'volume_create_manager' (39106ed4-cf41-4b80-8992-5b8f94424670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:35 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-60f4fd53-e57a-488c-947b-ae3578b60b6f tempest-ProjectReaderTests-65237529 None] Created volume successfully.
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "cinder-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:35 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0
Sep 06 17:18:35 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "cinder-quobyte-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5950c01-15ca-4f14-a404-df600fc04520]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:36 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5
Sep 06 17:18:36 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:36 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0" returned: 0 in 0.374s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:36 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b
Sep 06 17:18:36 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:36 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" returned: 0 in 0.402s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:36 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5
Sep 06 17:18:36 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Acquiring lock "cinder-4d85ceb5-389a-4ca7-b26b-845023853c4b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Lock "cinder-4d85ceb5-389a-4ca7-b26b-845023853c4b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Acquiring lock "cinder-quobyte-4d85ceb5-389a-4ca7-b26b-845023853c4b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Lock "cinder-quobyte-4d85ceb5-389a-4ca7-b26b-845023853c4b" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:36 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b" returned: 0 in 0.429s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9990e443-918b-4ad9-b0fb-1aea3ddada98]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:36 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b
Sep 06 17:18:36 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:36 devstack sudo[106673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b
Sep 06 17:18:36 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:36 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" returned: 0 in 0.299s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5" released by "delete_volume" :: held 0.768s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Created reservations ['4d4389b0-bc70-4d4b-80bd-16ec78b0ccd3', '32176db0-5faf-42ec-bb40-12c7604df1de', '7f32a553-815d-4e33-865f-50b2bb1b41c2', '4d7430be-28e4-421e-babb-34e86839f466'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:36 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0.6e4f69c3-a46f-426d-931e-ca30bd5a0d4b" returned: 0 in 0.275s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-6e4f69c3-a46f-426d-931e-ca30bd5a0d4b" released by "_delete_snapshot" :: held 1.569s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-af44c567-5f5f-4391-afef-4d6f53f0a3d0" released by "delete_snapshot" :: held 1.615s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:36 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:36 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Created reservations ['71bdf63e-3732-4340-aea1-ea7b71f4d97c', '0496cc91-6097-49bc-9794-8364f564b3da', 'd92c11a5-a373-4187-85b6-1136d09a5417', 'bae76a18-306b-43fc-884f-4c8301279ed1'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:36 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b" returned: 0 in 0.388s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:36 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b
Sep 06 17:18:36 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Delete snapshot completed successfully.
Sep 06 17:18:36 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23207d65-1a79-41bd-98d3-b34937206a79 tempest-ProjectMemberTests-218987786 None] Lock "cinder-6e4f69c3-a46f-426d-931e-ca30bd5a0d4b-delete_snapshot" released by "delete_snapshot" :: held 1.792s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "cinder-ee70b591-17e9-4412-ba69-48d85c3b3496-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-ee70b591-17e9-4412-ba69-48d85c3b3496-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "cinder-quobyte-ee70b591-17e9-4412-ba69-48d85c3b3496" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-ee70b591-17e9-4412-ba69-48d85c3b3496" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:37 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.303s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c527a5-7a06-472b-88bc-98dc3b0f7737]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Deleted volume successfully.
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-11dcf0b0-d61c-47a8-8c85-4570dfd0b59a tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-c5669fff-0f30-4ca6-a3e3-3f4814e30dc5-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:37 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4d85ceb5-389a-4ca7-b26b-845023853c4b" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Lock "cinder-quobyte-4d85ceb5-389a-4ca7-b26b-845023853c4b" released by "delete_volume" :: held 0.708s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:37 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Created reservations ['a5555411-38d1-4c66-98e9-165484771233', '1756feb8-8607-4df8-a255-7c1818d44742', 'b8db591a-d7ad-4181-81d7-9c617f3d0992', '6e00a1bd-d8d6-4567-8953-1311acf54f34'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:37 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:37 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:37 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-af44c567-5f5f-4391-afef-4d6f53f0a3d0-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Lock "cinder-af44c567-5f5f-4391-afef-4d6f53f0a3d0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-af44c567-5f5f-4391-afef-4d6f53f0a3d0" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-af44c567-5f5f-4391-afef-4d6f53f0a3d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e9d11a-dc07-486d-b011-f66dd78e7db1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:37 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496" returned: 0 in 0.410s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:37 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496
Sep 06 17:18:37 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:37 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.312s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:37 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Deleted volume successfully.
Sep 06 17:18:37 devstack sudo[106694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0
Sep 06 17:18:37 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-705819b7-44ce-4735-b12e-43b1c59b312d tempest-ProjectReaderTests-65237529 None] Lock "cinder-4d85ceb5-389a-4ca7-b26b-845023853c4b-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:37 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ee70b591-17e9-4412-ba69-48d85c3b3496" returned: 0 in 0.282s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-quobyte-ee70b591-17e9-4412-ba69-48d85c3b3496" released by "delete_volume" :: held 0.745s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Created reservations ['2609dd5a-054a-44e4-af26-f920308551e5', '6fb7088e-9f1d-4e0b-92be-69b4b0f40e78', '62dfc13c-e8a2-4a2d-a766-e34423c23035', 'c1bd8a45-0f7d-422e-a95c-89614c65b6e5'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:37 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0" returned: 0 in 0.409s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:37 devstack sudo[106703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0
Sep 06 17:18:37 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:38 devstack sudo[106705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:38 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:38 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-af44c567-5f5f-4391-afef-4d6f53f0a3d0" returned: 0 in 0.290s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-af44c567-5f5f-4391-afef-4d6f53f0a3d0" released by "delete_volume" :: held 0.788s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:38 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.332s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Created reservations ['18807eec-a114-4db1-be10-1e2bb8a37dd9', '5e3838cc-a3d8-4e55-a2f6-5cb3526521bc', 'a94c135b-4b84-4d54-b240-a01edeee015d', '8b9bde9f-9d92-4a5b-a509-48da4a8d88fc'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Deleted volume successfully.
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-f1ea7151-3485-4389-a4bb-2f16ed9d546d tempest-SnapshotDependencyTests-262516878 None] Lock "cinder-ee70b591-17e9-4412-ba69-48d85c3b3496-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:38 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:38 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:38 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.390s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Deleted volume successfully.
Sep 06 17:18:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9cb1ea97-871e-4174-9793-653d266acd14 tempest-ProjectMemberTests-218987786 None] Lock "cinder-af44c567-5f5f-4391-afef-4d6f53f0a3d0-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (7f6e2832-3c36-4bd1-9138-9b2736019da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d627ac-b638-4480-9d9f-98168e61c4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d627ac-b638-4480-9d9f-98168e61c4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584134208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4455f2-d4cc-446f-8214-3675dcc898c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:39Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4f4e7b-2696-4ba3-ba3e-e0d710c038e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4f4e7b-2696-4ba3-ba3e-e0d710c038e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e457718e-acd9-45b3-bb8d-9c132ce06732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e457718e-acd9-45b3-bb8d-9c132ce06732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4455f2-d4cc-446f-8214-3675dcc898c1', 'volume_name': 'volume-1b4455f2-d4cc-446f-8214-3675dcc898c1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fbb26e-72a9-41cd-818b-91b967bfb0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1fbb26e-72a9-41cd-818b-91b967bfb0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656fe735-4ee7-49db-8357-acca15d4a9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:39 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Volume 1b4455f2-d4cc-446f-8214-3675dcc898c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4455f2-d4cc-446f-8214-3675dcc898c1', 'volume_size': 1}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584134208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4455f2-d4cc-446f-8214-3675dcc898c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:39Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Creating volume 1b4455f2-d4cc-446f-8214-3675dcc898c1 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:39 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:39 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 1073741824
Sep 06 17:18:39 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:39 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 1073741824" returned: 0 in 0.522s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:39 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1
Sep 06 17:18:39 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:40 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1" returned: 0 in 0.290s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656fe735-4ee7-49db-8357-acca15d4a9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4455f2-d4cc-446f-8214-3675dcc898c1', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2cd132-d1f4-429f-9767-cebb64e5f1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:40 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Volume volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 (1b4455f2-d4cc-446f-8214-3675dcc898c1): created successfully
Sep 06 17:18:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2cd132-d1f4-429f-9767-cebb64e5f1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:40 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (7f6e2832-3c36-4bd1-9138-9b2736019da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-0e0f79d1-0a8b-4e74-ba1c-396a89275dd9 tempest-ProjectMemberTests-218987786 None] Created volume successfully.
Sep 06 17:18:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Creating offline snapshot 234870ab-dd7b-4592-aed4-9bbf642f76a7 of volume 1b4455f2-d4cc-446f-8214-3675dcc898c1 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:18:41 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f532d2b6-9cfd-46d3-a5a7-258b57624d63]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:41 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1
Sep 06 17:18:41 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:41 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1" returned: 0 in 0.350s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:41 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 1G
Sep 06 17:18:41 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:42 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 1G" returned: 0 in 0.443s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:42 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7
Sep 06 17:18:42 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:42 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7" returned: 0 in 0.301s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:42 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 is being set with open permissions: ugo+rw
Sep 06 17:18:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:42 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7
Sep 06 17:18:42 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:42 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7" returned: 0 in 0.265s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:42 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.info
Sep 06 17:18:42 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:43 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.info" returned: 0 in 0.309s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:43 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.info is being set with open permissions: ugo+rw
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:43 devstack sudo[106747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.info
Sep 06 17:18:43 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:43 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.info" returned: 0 in 0.245s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-07b3c03e-da6f-469d-8979-a28d9f4bf226 tempest-ProjectMemberTests-218987786 None] Create snapshot completed successfully
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-234870ab-dd7b-4592-aed4-9bbf642f76a7-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Lock "cinder-234870ab-dd7b-4592-aed4-9bbf642f76a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-1b4455f2-d4cc-446f-8214-3675dcc898c1" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-1b4455f2-d4cc-446f-8214-3675dcc898c1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-234870ab-dd7b-4592-aed4-9bbf642f76a7" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-234870ab-dd7b-4592-aed4-9bbf642f76a7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Deleting offline snapshot 234870ab-dd7b-4592-aed4-9bbf642f76a7 of volume 1b4455f2-d4cc-446f-8214-3675dcc898c1 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] snapshot_file for this snap is: volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b937a16-c729-4b89-aebc-b1eb6cb6e09d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:43 devstack sudo[106750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7
Sep 06 17:18:43 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:44 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7" returned: 0 in 0.382s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b4455f2-d4cc-446f-8214-3675dcc898c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:18:44 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87c42c-244f-4aad-9744-18901eb66fd1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:44 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1
Sep 06 17:18:44 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:44 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1" returned: 0 in 0.400s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:44 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7
Sep 06 17:18:44 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:44 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7" returned: 0 in 0.335s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:44 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7
Sep 06 17:18:44 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:45 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1.234870ab-dd7b-4592-aed4-9bbf642f76a7" returned: 0 in 0.241s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-234870ab-dd7b-4592-aed4-9bbf642f76a7" released by "_delete_snapshot" :: held 1.459s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-1b4455f2-d4cc-446f-8214-3675dcc898c1" released by "delete_snapshot" :: held 1.494s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Created reservations ['baf709c0-a6f0-4aaa-af62-94dd3e11564e', 'dd8ade82-c47d-43b3-be27-01fa939bed73', '365f80b9-f75f-4932-b50b-48d3ebb00cfd', 'ee7faf40-2f32-4505-ac5f-6d5a8e10e575'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Delete snapshot completed successfully.
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-209cdcc3-6765-4ce9-b73a-ee7736c70a92 tempest-ProjectMemberTests-218987786 None] Lock "cinder-234870ab-dd7b-4592-aed4-9bbf642f76a7-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-1b4455f2-d4cc-446f-8214-3675dcc898c1-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Lock "cinder-1b4455f2-d4cc-446f-8214-3675dcc898c1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-1b4455f2-d4cc-446f-8214-3675dcc898c1" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-1b4455f2-d4cc-446f-8214-3675dcc898c1" acquired by "delete_volume" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b276db-65e1-4ee4-bcf2-ad1672ea77f4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:46 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1
Sep 06 17:18:46 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:46 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1" returned: 0 in 0.379s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:46 devstack sudo[106775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1
Sep 06 17:18:46 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:46 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-1b4455f2-d4cc-446f-8214-3675dcc898c1" returned: 0 in 0.232s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-1b4455f2-d4cc-446f-8214-3675dcc898c1" released by "delete_volume" :: held 0.676s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Created reservations ['384ade30-510a-4d4b-b66f-84ea0195cb63', 'dbdf19af-ede1-4c92-8348-73f1c688b7e5', '35e152be-72e0-462d-bd5c-cafa50da2c16', '47599e7d-6499-4058-b44a-dbf59e704b15'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:46 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:46 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:47 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.370s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:47 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Deleted volume successfully.
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-87240de1-a7fb-4632-8dda-bc0db311b57e tempest-ProjectMemberTests-218987786 None] Lock "cinder-1b4455f2-d4cc-446f-8214-3675dcc898c1-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (71ba99fc-438c-4a0b-b286-ece0493fd443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f29175-8f0a-419a-84bc-6c91a35a3caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5f29175-8f0a-419a-84bc-6c91a35a3caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-523734965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbe6754-523a-41d6-9332-4f2837c30ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:47Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf803979-78e8-46d3-8084-f1b29a70a678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf803979-78e8-46d3-8084-f1b29a70a678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb832ad4-aaf5-4780-babd-ea3b9467d3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb832ad4-aaf5-4780-babd-ea3b9467d3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bbe6754-523a-41d6-9332-4f2837c30ac5', 'volume_name': 'volume-0bbe6754-523a-41d6-9332-4f2837c30ac5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c246ac-3068-4daa-824c-8694f5bcfd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c246ac-3068-4daa-824c-8694f5bcfd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064cc8b3-6fc0-404a-89ed-e0adc2dc1de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:47 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Volume 0bbe6754-523a-41d6-9332-4f2837c30ac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bbe6754-523a-41d6-9332-4f2837c30ac5', 'volume_size': 1}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-523734965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbe6754-523a-41d6-9332-4f2837c30ac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:47Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Creating volume 0bbe6754-523a-41d6-9332-4f2837c30ac5 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:47 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:47 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 1073741824
Sep 06 17:18:47 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:48 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 1073741824" returned: 0 in 0.475s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:48 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5
Sep 06 17:18:48 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:48 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5" returned: 0 in 0.242s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064cc8b3-6fc0-404a-89ed-e0adc2dc1de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bbe6754-523a-41d6-9332-4f2837c30ac5', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bda76d3-9664-4286-851a-3e95da0a3b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:48 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Volume volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 (0bbe6754-523a-41d6-9332-4f2837c30ac5): created successfully
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bda76d3-9664-4286-851a-3e95da0a3b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (71ba99fc-438c-4a0b-b286-ece0493fd443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-cc1938dc-75d5-4e21-9677-b2f0f2105346 tempest-ProjectMemberTests-218987786 None] Created volume successfully.
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Creating offline snapshot 9d921ab4-2c28-4b4e-a879-1e0958311183 of volume 0bbe6754-523a-41d6-9332-4f2837c30ac5 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9616d4f-3c9e-4970-bf0a-888be9e30804]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:48 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5
Sep 06 17:18:48 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:49 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5" returned: 0 in 0.387s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:49 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 1G
Sep 06 17:18:49 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:49 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 1G" returned: 0 in 0.467s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:49 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183
Sep 06 17:18:49 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:49 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183" returned: 0 in 0.307s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:49 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 is being set with open permissions: ugo+rw
Sep 06 17:18:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:49 devstack sudo[106808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183
Sep 06 17:18:49 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:50 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:50 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.info
Sep 06 17:18:50 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:50 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.info" returned: 0 in 0.236s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:50 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.info is being set with open permissions: ugo+rw
Sep 06 17:18:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:50 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.info
Sep 06 17:18:50 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:50 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.info" returned: 0 in 0.258s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:50 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ef889e06-8451-4842-b09a-bc72f74958df tempest-ProjectMemberTests-218987786 None] Create snapshot completed successfully
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-9d921ab4-2c28-4b4e-a879-1e0958311183-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Lock "cinder-9d921ab4-2c28-4b4e-a879-1e0958311183-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-0bbe6754-523a-41d6-9332-4f2837c30ac5" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-0bbe6754-523a-41d6-9332-4f2837c30ac5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-9d921ab4-2c28-4b4e-a879-1e0958311183" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-9d921ab4-2c28-4b4e-a879-1e0958311183" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Deleting offline snapshot 9d921ab4-2c28-4b4e-a879-1e0958311183 of volume 0bbe6754-523a-41d6-9332-4f2837c30ac5 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] snapshot_file for this snap is: volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a52d3a6-dc01-4267-9552-5f04d40c58d6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:52 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183
Sep 06 17:18:52 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:52 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183" returned: 0 in 0.337s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:52 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0bbe6754-523a-41d6-9332-4f2837c30ac5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:18:52 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af460ab-310a-48ce-8950-81ba86c63456]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:52 devstack sudo[106823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5
Sep 06 17:18:52 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:52 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:52 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183
Sep 06 17:18:52 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:52 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183" returned: 0 in 0.358s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:53 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183
Sep 06 17:18:53 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:53 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5.9d921ab4-2c28-4b4e-a879-1e0958311183" returned: 0 in 0.237s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-9d921ab4-2c28-4b4e-a879-1e0958311183" released by "_delete_snapshot" :: held 1.361s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-0bbe6754-523a-41d6-9332-4f2837c30ac5" released by "delete_snapshot" :: held 1.382s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:53 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=140,cinder:INSERT=46,cinder:UPDATE=185,cinder:DELETE=16 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:18:53 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Created reservations ['5c17ff2f-4ecc-4295-8e3a-10357cecb384', '5d6cd8fc-9291-4cdc-b255-d4001308f884', '0f841bac-db92-488b-8a58-c550dfdfc9aa', 'a5d26431-57e8-42d6-9a81-3c8ada696ce3'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:53 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Delete snapshot completed successfully.
Sep 06 17:18:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-3f78069a-af59-477f-90d5-efd1f250b377 tempest-ProjectMemberTests-218987786 None] Lock "cinder-9d921ab4-2c28-4b4e-a879-1e0958311183-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-0bbe6754-523a-41d6-9332-4f2837c30ac5-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Lock "cinder-0bbe6754-523a-41d6-9332-4f2837c30ac5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-0bbe6754-523a-41d6-9332-4f2837c30ac5" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-0bbe6754-523a-41d6-9332-4f2837c30ac5" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a74361-e736-4c72-980b-18d973a4404d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:54 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5
Sep 06 17:18:54 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:54 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5" returned: 0 in 0.369s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:54 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5
Sep 06 17:18:54 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:54 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-0bbe6754-523a-41d6-9332-4f2837c30ac5" returned: 0 in 0.249s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-0bbe6754-523a-41d6-9332-4f2837c30ac5" released by "delete_volume" :: held 0.672s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Created reservations ['47c240ac-cca8-4efd-a0c6-1ce72341bc83', '4fb7b225-5b5b-474f-a5c6-7e357e76bd5d', '9e157964-a16d-4fe0-ae4b-8217e57fcd48', '249b6b74-115f-4477-8f35-57f88013c792'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:54 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:18:54 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:55 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.233s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:18:55 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Deleted volume successfully.
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4c11689f-3f69-4c32-b681-143e6215ff69 tempest-ProjectMemberTests-218987786 None] Lock "cinder-0bbe6754-523a-41d6-9332-4f2837c30ac5-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (003750a4-c0d6-4d1c-b33d-7104c5e10a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e450037-4c64-41cc-83e6-20fc32c1f495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e450037-4c64-41cc-83e6-20fc32c1f495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-439825140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4577ac57-26b6-426f-bc5d-ec0b0956054a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:56Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0278d0f-1492-4df3-8230-7cf41121e395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0278d0f-1492-4df3-8230-7cf41121e395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb42322a-a86e-450b-8fd1-acf20aeeb88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb42322a-a86e-450b-8fd1-acf20aeeb88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4577ac57-26b6-426f-bc5d-ec0b0956054a', 'volume_name': 'volume-4577ac57-26b6-426f-bc5d-ec0b0956054a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513f5ee1-c21d-4c34-bba2-8daa8c175ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (513f5ee1-c21d-4c34-bba2-8daa8c175ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a864b85e-79c0-4e25-9e3b-db847b7cec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:55 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Volume 4577ac57-26b6-426f-bc5d-ec0b0956054a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4577ac57-26b6-426f-bc5d-ec0b0956054a', 'volume_size': 1}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-439825140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4577ac57-26b6-426f-bc5d-ec0b0956054a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:18:56Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Creating volume 4577ac57-26b6-426f-bc5d-ec0b0956054a {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:18:55 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:18:55 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:55 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a 1073741824
Sep 06 17:18:55 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:56 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a 1073741824" returned: 0 in 0.393s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:56 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a
Sep 06 17:18:56 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:56 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a" returned: 0 in 0.258s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a864b85e-79c0-4e25-9e3b-db847b7cec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4577ac57-26b6-426f-bc5d-ec0b0956054a', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9d6d8e-ac2f-4377-916e-1a164b8a34f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:18:56 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Volume volume-4577ac57-26b6-426f-bc5d-ec0b0956054a (4577ac57-26b6-426f-bc5d-ec0b0956054a): created successfully
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9d6d8e-ac2f-4377-916e-1a164b8a34f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (003750a4-c0d6-4d1c-b33d-7104c5e10a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:18:56 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4dc44565-f702-459b-b1bb-8c110d083414 tempest-ProjectMemberTests-218987786 None] Created volume successfully.
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Creating offline snapshot eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 of volume 4577ac57-26b6-426f-bc5d-ec0b0956054a {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dae0d54-1cfe-4eda-b765-276973ccfe81]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:56 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:56 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a
Sep 06 17:18:56 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:57 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a" returned: 0 in 0.342s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:57 devstack sudo[106860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 1G
Sep 06 17:18:57 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:57 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 1G" returned: 0 in 0.368s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4577ac57-26b6-426f-bc5d-ec0b0956054a -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:57 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4577ac57-26b6-426f-bc5d-ec0b0956054a -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92
Sep 06 17:18:57 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:57 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4577ac57-26b6-426f-bc5d-ec0b0956054a -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92" returned: 0 in 0.280s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:57 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 is being set with open permissions: ugo+rw
Sep 06 17:18:57 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:57 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92
Sep 06 17:18:57 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:57 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:58 devstack sudo[106873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.info
Sep 06 17:18:58 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:58 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.info" returned: 0 in 0.231s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:58 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.info is being set with open permissions: ugo+rw
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:58 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.info
Sep 06 17:18:58 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:58 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.info" returned: 0 in 0.230s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.760s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:18:58 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-dcb86f72-b843-4506-b3bf-4094bb57275d tempest-ProjectMemberTests-218987786 None] Create snapshot completed successfully
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Lock "cinder-eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-4577ac57-26b6-426f-bc5d-ec0b0956054a" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-4577ac57-26b6-426f-bc5d-ec0b0956054a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Deleting offline snapshot eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 of volume 4577ac57-26b6-426f-bc5d-ec0b0956054a {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] snapshot_file for this snap is: volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c9b66b-e84d-4c3b-a2b2-a9992ecc5f7e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:58 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:59 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92
Sep 06 17:18:59 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:59 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92" returned: 0 in 0.341s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:59 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4577ac57-26b6-426f-bc5d-ec0b0956054a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:18:59 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[49df3b23-8350-48ab-a62e-cc1330f5a9d6]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:18:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:59 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a
Sep 06 17:18:59 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:59 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a" returned: 0 in 0.340s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:18:59 devstack sudo[106889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92
Sep 06 17:18:59 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:18:59 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root
Sep 06 17:18:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92" returned: 0 in 0.342s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:18:59 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:00 devstack sudo[106894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92
Sep 06 17:19:00 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:00 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:00 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a.eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92" returned: 0 in 0.230s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92" released by "_delete_snapshot" :: held 1.331s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-4577ac57-26b6-426f-bc5d-ec0b0956054a" released by "delete_snapshot" :: held 1.350s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:00 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Created reservations ['54e0c7ce-76e8-4f3d-99b3-1bf07c8d2f95', '2e068d0a-40ac-4e7d-94fe-fd2759bb2a21', '948945e3-bb03-4dea-97f3-a37b6e6795cf', 'ac8f0a53-30a9-4dc1-9903-2f49af31b3ee'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:00 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Delete snapshot completed successfully.
Sep 06 17:19:00 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9bd61add-e446-4395-a8b3-71b8184309ae tempest-ProjectMemberTests-218987786 None] Lock "cinder-eab32a5c-57fe-4ea2-97fb-8c0aa2f2da92-delete_snapshot" released by "delete_snapshot" :: held 1.488s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-4577ac57-26b6-426f-bc5d-ec0b0956054a-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Lock "cinder-4577ac57-26b6-426f-bc5d-ec0b0956054a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-4577ac57-26b6-426f-bc5d-ec0b0956054a" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-4577ac57-26b6-426f-bc5d-ec0b0956054a" acquired by "delete_volume" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59003d4-740f-48b3-a89e-d34cbe8767aa]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:01 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a
Sep 06 17:19:01 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:01 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a" returned: 0 in 0.331s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:01 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a
Sep 06 17:19:01 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:01 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-4577ac57-26b6-426f-bc5d-ec0b0956054a" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-4577ac57-26b6-426f-bc5d-ec0b0956054a" released by "delete_volume" :: held 0.620s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Created reservations ['3604f939-0406-465f-bb62-8495ebceb47d', 'fe6e202e-18f3-4192-be8f-f5433e3da7cb', '69942b92-fef0-418d-9bac-e7124c65ca43', 'feb6319c-6226-47e3-9e2a-88aba06e32b0'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:01 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:01 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:19:01 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:02 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:19:02 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Deleted volume successfully.
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-4922c1a2-cd57-4b19-8c2b-d1480c5d1a0f tempest-ProjectMemberTests-218987786 None] Lock "cinder-4577ac57-26b6-426f-bc5d-ec0b0956054a-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (28c5f4d8-6320-4c05-884b-65c417610778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d8001b-954b-4613-b782-891d517ec226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d8001b-954b-4613-b782-891d517ec226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-646656856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763f9d26-3197-4784-ba97-de3f7f841043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:03Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5b9bcf-9705-4579-b2a4-f53b4f622a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5b9bcf-9705-4579-b2a4-f53b4f622a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0175af-4747-40e0-9ab7-bc13f0c4f290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0175af-4747-40e0-9ab7-bc13f0c4f290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '763f9d26-3197-4784-ba97-de3f7f841043', 'volume_name': 'volume-763f9d26-3197-4784-ba97-de3f7f841043', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a491503e-5177-44a9-af94-f43a337ee210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a491503e-5177-44a9-af94-f43a337ee210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5973401-b925-45f6-b8c2-5e4b1881467b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:02 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Volume 763f9d26-3197-4784-ba97-de3f7f841043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-763f9d26-3197-4784-ba97-de3f7f841043', 'volume_size': 1}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-646656856',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763f9d26-3197-4784-ba97-de3f7f841043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:03Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Creating volume 763f9d26-3197-4784-ba97-de3f7f841043 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:19:02 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:19:02 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:02 devstack sudo[106909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043 1073741824
Sep 06 17:19:02 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:03 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043 1073741824" returned: 0 in 0.394s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:03 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043
Sep 06 17:19:03 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:03 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043" returned: 0 in 0.233s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5973401-b925-45f6-b8c2-5e4b1881467b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763f9d26-3197-4784-ba97-de3f7f841043', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78dbcf67-57c1-45c0-be95-9baf2c113899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:03 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Volume volume-763f9d26-3197-4784-ba97-de3f7f841043 (763f9d26-3197-4784-ba97-de3f7f841043): created successfully
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78dbcf67-57c1-45c0-be95-9baf2c113899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (28c5f4d8-6320-4c05-884b-65c417610778) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:03 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8fbc7d50-ae1d-4047-b6f0-0ea280a67c0f tempest-ProjectMemberTests-218987786 None] Created volume successfully.
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Creating offline snapshot be122a70-7d0d-49a7-a712-1c75c9ec7fb3 of volume 763f9d26-3197-4784-ba97-de3f7f841043 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f5b042-1fe6-443e-b106-1d919aa29e12]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:03 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:03 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043
Sep 06 17:19:03 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:04 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043" returned: 0 in 0.334s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:04 devstack sudo[106922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 1G
Sep 06 17:19:04 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:04 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 1G" returned: 0 in 0.356s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-763f9d26-3197-4784-ba97-de3f7f841043 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:04 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-763f9d26-3197-4784-ba97-de3f7f841043 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3
Sep 06 17:19:04 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:04 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-763f9d26-3197-4784-ba97-de3f7f841043 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3" returned: 0 in 0.279s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:04 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 is being set with open permissions: ugo+rw
Sep 06 17:19:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:04 devstack sudo[106933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3
Sep 06 17:19:04 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:04 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:04 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3" returned: 0 in 0.228s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:04 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=153,cinder:INSERT=52,cinder:UPDATE=188,cinder:DELETE=16 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:05 devstack sudo[106936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.info
Sep 06 17:19:05 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:05 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.info" returned: 0 in 0.259s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:05 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.info is being set with open permissions: ugo+rw
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:05 devstack sudo[106939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.info
Sep 06 17:19:05 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:05 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.info" returned: 0 in 0.235s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.768s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:05 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ec16144f-9e0b-447e-ab9c-145a90055a7d tempest-ProjectMemberTests-218987786 None] Create snapshot completed successfully
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-be122a70-7d0d-49a7-a712-1c75c9ec7fb3-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Lock "cinder-be122a70-7d0d-49a7-a712-1c75c9ec7fb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-763f9d26-3197-4784-ba97-de3f7f841043" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-763f9d26-3197-4784-ba97-de3f7f841043" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-be122a70-7d0d-49a7-a712-1c75c9ec7fb3" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-be122a70-7d0d-49a7-a712-1c75c9ec7fb3" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Deleting offline snapshot be122a70-7d0d-49a7-a712-1c75c9ec7fb3 of volume 763f9d26-3197-4784-ba97-de3f7f841043 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] snapshot_file for this snap is: volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[3339570b-a420-48bd-9c1e-2ebdd3fa5d9f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:05 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:06 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3
Sep 06 17:19:06 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:06 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3" returned: 0 in 0.336s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:06 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-763f9d26-3197-4784-ba97-de3f7f841043(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:19:06 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b067c41-7dac-4a6a-843a-db076aaaeaf7]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:06 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043
Sep 06 17:19:06 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:06 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043" returned: 0 in 0.357s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:06 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:06 devstack sudo[106988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3
Sep 06 17:19:06 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:07 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3" returned: 0 in 0.331s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:07 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3
Sep 06 17:19:07 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:07 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:07 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043.be122a70-7d0d-49a7-a712-1c75c9ec7fb3" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-be122a70-7d0d-49a7-a712-1c75c9ec7fb3" released by "_delete_snapshot" :: held 1.343s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-763f9d26-3197-4784-ba97-de3f7f841043" released by "delete_snapshot" :: held 1.363s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:07 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Created reservations ['4a0eae34-d6f4-4a37-bd88-e118b09049cf', 'e248d60f-e3c4-403e-850c-26fbc5ed5684', '6adde7aa-2acf-4e61-8dfe-5822be17585d', 'cde7e1fe-1ca1-4c2f-af12-596e1bfeebb8'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:07 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Delete snapshot completed successfully.
Sep 06 17:19:07 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e6a8a39f-fd36-4640-b4c2-a9b3759d9502 tempest-ProjectMemberTests-218987786 None] Lock "cinder-be122a70-7d0d-49a7-a712-1c75c9ec7fb3-delete_snapshot" released by "delete_snapshot" :: held 1.486s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-763f9d26-3197-4784-ba97-de3f7f841043-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Lock "cinder-763f9d26-3197-4784-ba97-de3f7f841043-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-763f9d26-3197-4784-ba97-de3f7f841043" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-763f9d26-3197-4784-ba97-de3f7f841043" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c11ff2a-38fa-4ae6-864e-530fa0bc468f]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:08 devstack sudo[106998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043
Sep 06 17:19:08 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:08 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043" returned: 0 in 0.335s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:08 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043
Sep 06 17:19:08 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:08 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-763f9d26-3197-4784-ba97-de3f7f841043" returned: 0 in 0.259s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-763f9d26-3197-4784-ba97-de3f7f841043" released by "delete_volume" :: held 0.651s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Created reservations ['18830285-baef-49a9-8cda-16a6b36428b8', '883d0c4b-a382-4fe8-9dbf-53f988d30600', 'b5e921cd-e8dc-4dff-8af5-3e830f7b6cec', 'cc68e907-1310-4a21-98a7-a49278d16c6a'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:08 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:08 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:19:08 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:09 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.249s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:19:09 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Deleted volume successfully.
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e9f24644-9a7e-49f3-beaa-069f07d07132 tempest-ProjectMemberTests-218987786 None] Lock "cinder-763f9d26-3197-4784-ba97-de3f7f841043-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (3dd6810c-336e-42c0-85f8-47daffcd2d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bb46fc-7ab2-4bf0-8522-d559d3eacaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49bb46fc-7ab2-4bf0-8522-d559d3eacaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368127741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50b5ae1-3d72-4dea-a033-2f5a37d8a850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:10Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eb36b8-eb75-435b-8c3f-8a5e0f91aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eb36b8-eb75-435b-8c3f-8a5e0f91aad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecdf30e-acbd-4fe0-90fa-94e3a291a5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecdf30e-acbd-4fe0-90fa-94e3a291a5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50b5ae1-3d72-4dea-a033-2f5a37d8a850', 'volume_name': 'volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5f114f-cb0f-4896-b3d7-8b37b3a7cf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5f114f-cb0f-4896-b3d7-8b37b3a7cf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e86f350-3976-44a7-b616-da895e85815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:09 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Volume f50b5ae1-3d72-4dea-a033-2f5a37d8a850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850', 'volume_size': 1}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368127741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50b5ae1-3d72-4dea-a033-2f5a37d8a850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcb6a81a601f4391863c3d74a6f59c9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:10Z,use_quota=True,user_id='acf50717df404af1a2188a6f0a86e19e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Creating volume f50b5ae1-3d72-4dea-a033-2f5a37d8a850 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:19:09 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:19:09 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:09 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 1073741824
Sep 06 17:19:09 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:10 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 1073741824" returned: 0 in 0.419s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:10 devstack sudo[107014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850
Sep 06 17:19:10 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:10 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" returned: 0 in 0.233s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e86f350-3976-44a7-b616-da895e85815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737abb86-8e35-4275-90c5-ad7f6135b02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:10 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Volume volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 (f50b5ae1-3d72-4dea-a033-2f5a37d8a850): created successfully
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737abb86-8e35-4275-90c5-ad7f6135b02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Flow 'volume_create_manager' (3dd6810c-336e-42c0-85f8-47daffcd2d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:10 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-823b65d7-190e-4f42-ba76-6d5b7a41f64c tempest-ProjectMemberTests-218987786 None] Created volume successfully.
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Creating offline snapshot 0fe68053-877e-488f-8150-70eb2c177c77 of volume f50b5ae1-3d72-4dea-a033-2f5a37d8a850 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffd8771-fed3-4e18-b31d-efec5b402577]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:10 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:10 devstack sudo[107017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850
Sep 06 17:19:10 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:11 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" returned: 0 in 0.360s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:11 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 1G
Sep 06 17:19:11 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:11 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 1G" returned: 0 in 0.383s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:11 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77
Sep 06 17:19:11 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:11 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77" returned: 0 in 0.305s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:11 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 is being set with open permissions: ugo+rw
Sep 06 17:19:11 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:11 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77
Sep 06 17:19:11 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:12 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77" returned: 0 in 0.247s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:12 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.info
Sep 06 17:19:12 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:12 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.info" returned: 0 in 0.258s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:12 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.info is being set with open permissions: ugo+rw
Sep 06 17:19:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:12 devstack sudo[107040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.info
Sep 06 17:19:12 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:12 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.info" returned: 0 in 0.244s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:12 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:12 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-35630ebb-e0f4-4de9-b501-45a4db96f110 tempest-ProjectMemberTests-218987786 None] Create snapshot completed successfully
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-0fe68053-877e-488f-8150-70eb2c177c77-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Lock "cinder-0fe68053-877e-488f-8150-70eb2c177c77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-0fe68053-877e-488f-8150-70eb2c177c77" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-0fe68053-877e-488f-8150-70eb2c177c77" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Deleting offline snapshot 0fe68053-877e-488f-8150-70eb2c177c77 of volume f50b5ae1-3d72-4dea-a033-2f5a37d8a850 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] snapshot_file for this snap is: volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a810ffe-cc8f-431c-8b61-009452681dbd]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:13 devstack sudo[107043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77
Sep 06 17:19:13 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:13 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77" returned: 0 in 0.340s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3a0fef-e7fe-4999-8d5b-f2a140f7b80d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:13 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850
Sep 06 17:19:13 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:13 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" returned: 0 in 0.343s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:13 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:13 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77
Sep 06 17:19:13 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:14 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77" returned: 0 in 0.315s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:14 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77
Sep 06 17:19:14 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:14 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:14 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850.0fe68053-877e-488f-8150-70eb2c177c77" returned: 0 in 0.234s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-0fe68053-877e-488f-8150-70eb2c177c77" released by "_delete_snapshot" :: held 1.320s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" released by "delete_snapshot" :: held 1.339s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:14 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Created reservations ['122434e6-cd31-4a91-9082-5036db347337', '32ef563c-7efa-4d09-9016-1cd157998e5e', '33cc1fb8-329f-4b32-a153-b94cc346a38f', '09a904f9-6b16-4279-a604-7ea64b6f6041'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:14 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Delete snapshot completed successfully.
Sep 06 17:19:14 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-23add6fa-223c-4b46-8559-379a09b580a9 tempest-ProjectMemberTests-218987786 None] Lock "cinder-0fe68053-877e-488f-8150-70eb2c177c77-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-f50b5ae1-3d72-4dea-a033-2f5a37d8a850-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Lock "cinder-f50b5ae1-3d72-4dea-a033-2f5a37d8a850-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Acquiring lock "cinder-quobyte-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" acquired by "delete_volume" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[864cdae7-1c03-4805-b8b1-34656d9f8d5e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:15 devstack sudo[107061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850
Sep 06 17:19:15 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:15 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" returned: 0 in 0.343s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:15 devstack sudo[107066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850
Sep 06 17:19:15 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:15 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" returned: 0 in 0.234s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Lock "cinder-quobyte-f50b5ae1-3d72-4dea-a033-2f5a37d8a850" released by "delete_volume" :: held 0.630s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Created reservations ['939fd016-76d3-4cde-b7db-950af0517956', '23fa3f02-9b36-4af0-aa50-edbbe9cc2db1', 'd9c94297-c6bf-407e-a89c-074c6dd9fd2e', '2c34b630-3851-4082-9406-65f3f9ff445d'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:15 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:16 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:19:16 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:16 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:16 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.240s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:16 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:19:16 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Deleted volume successfully.
Sep 06 17:19:16 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ff607178-c53e-4ba2-a566-34d1555ba369 tempest-ProjectMemberTests-218987786 None] Lock "cinder-f50b5ae1-3d72-4dea-a033-2f5a37d8a850-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (c49b6095-709d-4d07-a433-d5efda6bf841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0049eecb-b124-4a2d-afec-c7739cd9e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0049eecb-b124-4a2d-afec-c7739cd9e74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2077258348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579ca2d0-19c8-4f1c-9484-fb835e61226b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:20Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b02c590-bc95-47ca-a34f-4934de429187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b02c590-bc95-47ca-a34f-4934de429187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d345fa7-af23-4e54-baae-80f86b90a4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d345fa7-af23-4e54-baae-80f86b90a4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '579ca2d0-19c8-4f1c-9484-fb835e61226b', 'volume_name': 'volume-579ca2d0-19c8-4f1c-9484-fb835e61226b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee48fb0f-4f42-4654-9285-2852b6621355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee48fb0f-4f42-4654-9285-2852b6621355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6ed85e-f5ff-42ef-8c65-67c58382c5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:19 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Volume 579ca2d0-19c8-4f1c-9484-fb835e61226b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-579ca2d0-19c8-4f1c-9484-fb835e61226b', 'volume_size': 1}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2077258348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=579ca2d0-19c8-4f1c-9484-fb835e61226b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:20Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Creating volume 579ca2d0-19c8-4f1c-9484-fb835e61226b {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:19:19 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:19:19 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:19 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b 1073741824
Sep 06 17:19:19 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:20 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b 1073741824" returned: 0 in 0.407s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:20 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b
Sep 06 17:19:20 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:20 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b" returned: 0 in 0.235s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6ed85e-f5ff-42ef-8c65-67c58382c5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-579ca2d0-19c8-4f1c-9484-fb835e61226b', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e10756-8e5e-4d13-8763-85d79e74e9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:20 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Volume volume-579ca2d0-19c8-4f1c-9484-fb835e61226b (579ca2d0-19c8-4f1c-9484-fb835e61226b): created successfully
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e10756-8e5e-4d13-8763-85d79e74e9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (c49b6095-709d-4d07-a433-d5efda6bf841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:20 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-945b2594-6e16-4a60-8ae0-76bbec21758b tempest-ProjectReaderTests-464573050 None] Created volume successfully.
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:20 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Creating offline snapshot 0e702906-2aff-4f95-b0de-8156f57124be of volume 579ca2d0-19c8-4f1c-9484-fb835e61226b {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:19:21 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[09424035-db2e-40b5-b575-b01376d57b0d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:21 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b
Sep 06 17:19:21 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:21 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b" returned: 0 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:21 devstack sudo[107092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be 1G
Sep 06 17:19:21 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:21 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be 1G" returned: 0 in 0.371s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:21 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579ca2d0-19c8-4f1c-9484-fb835e61226b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:21 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579ca2d0-19c8-4f1c-9484-fb835e61226b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be
Sep 06 17:19:21 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:22 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-579ca2d0-19c8-4f1c-9484-fb835e61226b -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be" returned: 0 in 0.270s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:22 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be is being set with open permissions: ugo+rw
Sep 06 17:19:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:22 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be
Sep 06 17:19:22 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:22 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be" returned: 0 in 0.252s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:22 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.info
Sep 06 17:19:22 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:22 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.info" returned: 0 in 0.252s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:22 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.info is being set with open permissions: ugo+rw
Sep 06 17:19:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:22 devstack sudo[107109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.info
Sep 06 17:19:22 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:22 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.info" returned: 0 in 0.251s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:22 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:22 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-fdd86e67-5097-43cb-93cc-3eeedd0f60ab tempest-ProjectReaderTests-464573050 None] Create snapshot completed successfully
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-0e702906-2aff-4f95-b0de-8156f57124be-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Lock "cinder-0e702906-2aff-4f95-b0de-8156f57124be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-579ca2d0-19c8-4f1c-9484-fb835e61226b" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-579ca2d0-19c8-4f1c-9484-fb835e61226b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-0e702906-2aff-4f95-b0de-8156f57124be" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-0e702906-2aff-4f95-b0de-8156f57124be" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Deleting offline snapshot 0e702906-2aff-4f95-b0de-8156f57124be of volume 579ca2d0-19c8-4f1c-9484-fb835e61226b {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] snapshot_file for this snap is: volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[653db737-c386-4eaa-9c68-e57ca485c7b1]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:23 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be
Sep 06 17:19:23 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:23 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be" returned: 0 in 0.352s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-579ca2d0-19c8-4f1c-9484-fb835e61226b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[732683c1-ebdd-476c-8542-0e9eb4f6404a]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:23 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:23 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b
Sep 06 17:19:23 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:24 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b" returned: 0 in 0.336s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:24 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be
Sep 06 17:19:24 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:24 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be" returned: 0 in 0.319s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:24 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be
Sep 06 17:19:24 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:24 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:24 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b.0e702906-2aff-4f95-b0de-8156f57124be" returned: 0 in 0.233s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-0e702906-2aff-4f95-b0de-8156f57124be" released by "_delete_snapshot" :: held 1.330s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-579ca2d0-19c8-4f1c-9484-fb835e61226b" released by "delete_snapshot" :: held 1.349s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:24 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Created reservations ['e6ef6354-776b-42c0-a894-8760d27d65fe', '84a9b243-4634-4890-a9f0-a1a2229dfdd8', 'a8758ae5-f601-4b5c-95c1-07fb25f58839', '1b2cf500-7b1b-45f8-b898-4b43d80ee222'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:24 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Delete snapshot completed successfully.
Sep 06 17:19:24 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-ee6a8414-143d-4b75-a47c-a6652406eea0 tempest-ProjectReaderTests-464573050 None] Lock "cinder-0e702906-2aff-4f95-b0de-8156f57124be-delete_snapshot" released by "delete_snapshot" :: held 1.476s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-579ca2d0-19c8-4f1c-9484-fb835e61226b-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Lock "cinder-579ca2d0-19c8-4f1c-9484-fb835e61226b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-579ca2d0-19c8-4f1c-9484-fb835e61226b" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:25 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-579ca2d0-19c8-4f1c-9484-fb835e61226b" acquired by "delete_volume" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:25 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[e980e349-3f47-4434-ad27-f7ee3d53eb02]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:25 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b
Sep 06 17:19:25 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:25 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b" returned: 0 in 0.337s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:25 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:25 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b
Sep 06 17:19:25 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:26 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-579ca2d0-19c8-4f1c-9484-fb835e61226b" returned: 0 in 0.240s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-579ca2d0-19c8-4f1c-9484-fb835e61226b" released by "delete_volume" :: held 0.631s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:26 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:19:26 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Created reservations ['f2c6ca7f-b9c8-47d0-9073-a736fb53dbd3', '284941f1-5e44-4317-9081-c778f1f7c350', '1f7dd27c-4120-4aeb-9a00-2aa3f6c14349', '8fe197b7-e18f-44e8-9407-3dd41036c9da'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:26 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:19:26 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:26 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.248s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 06 17:19:26 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.228s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:19:26 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Deleted volume successfully.
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-b62a87f2-1f4d-4094-99c0-0df992b31b37 tempest-ProjectReaderTests-464573050 None] Lock "cinder-579ca2d0-19c8-4f1c-9484-fb835e61226b-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (7109fbab-26b5-418f-9f60-e5797f317133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34c4ec5-e4c7-40d4-9c29-b643a1c8a068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34c4ec5-e4c7-40d4-9c29-b643a1c8a068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1643300752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c25d77-b9d1-42b0-bfdc-48980f327a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:27Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb232c3-63d8-4fe3-8e44-353dd19aff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebb232c3-63d8-4fe3-8e44-353dd19aff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32e5bae-ac90-476d-ad4b-9f3debe0a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d32e5bae-ac90-476d-ad4b-9f3debe0a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c25d77-b9d1-42b0-bfdc-48980f327a20', 'volume_name': 'volume-60c25d77-b9d1-42b0-bfdc-48980f327a20', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b900e9b9-e33d-4442-a59c-234bf5c04397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b900e9b9-e33d-4442-a59c-234bf5c04397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd58fe9-1301-433a-b5f4-6a8c4c405443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:27 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Volume 60c25d77-b9d1-42b0-bfdc-48980f327a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c25d77-b9d1-42b0-bfdc-48980f327a20', 'volume_size': 1}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1643300752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c25d77-b9d1-42b0-bfdc-48980f327a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:27Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Creating volume 60c25d77-b9d1-42b0-bfdc-48980f327a20 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:19:27 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:27 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 1073741824
Sep 06 17:19:27 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:27 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 1073741824" returned: 0 in 0.418s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:27 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20
Sep 06 17:19:27 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:27 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20" returned: 0 in 0.274s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd58fe9-1301-433a-b5f4-6a8c4c405443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c25d77-b9d1-42b0-bfdc-48980f327a20', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a41642-f0fc-478a-afa3-0c3cf8f7ea83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:27 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Volume volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 (60c25d77-b9d1-42b0-bfdc-48980f327a20): created successfully
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a41642-f0fc-478a-afa3-0c3cf8f7ea83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:27 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (7109fbab-26b5-418f-9f60-e5797f317133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:27 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-74831444-e8fe-42e8-ad3e-2bb818c23a9c tempest-ProjectReaderTests-464573050 None] Created volume successfully.
Sep 06 17:19:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:28 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Creating offline snapshot f128b171-6714-4871-88ad-747a8a03a683 of volume 60c25d77-b9d1-42b0-bfdc-48980f327a20 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:19:28 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac28459-d888-4062-80d8-2052da7ee32b]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:28 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20
Sep 06 17:19:28 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:28 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20" returned: 0 in 0.343s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:28 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 1G
Sep 06 17:19:28 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:28 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 1G" returned: 0 in 0.385s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:28 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:28 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683
Sep 06 17:19:28 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:29 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683" returned: 0 in 0.276s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:29 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 is being set with open permissions: ugo+rw
Sep 06 17:19:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:29 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683
Sep 06 17:19:29 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:29 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683" returned: 0 in 0.238s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:29 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.info
Sep 06 17:19:29 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:29 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.info" returned: 0 in 0.244s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:29 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.info is being set with open permissions: ugo+rw
Sep 06 17:19:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:29 devstack sudo[107176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.info
Sep 06 17:19:29 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:29 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.info" returned: 0 in 0.242s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:29 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:29 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-dbbe8093-ed9a-4ed1-a110-5b438113d840 tempest-ProjectReaderTests-464573050 None] Create snapshot completed successfully
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-f128b171-6714-4871-88ad-747a8a03a683-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Lock "cinder-f128b171-6714-4871-88ad-747a8a03a683-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-60c25d77-b9d1-42b0-bfdc-48980f327a20" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-60c25d77-b9d1-42b0-bfdc-48980f327a20" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-f128b171-6714-4871-88ad-747a8a03a683" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-f128b171-6714-4871-88ad-747a8a03a683" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Deleting offline snapshot f128b171-6714-4871-88ad-747a8a03a683 of volume 60c25d77-b9d1-42b0-bfdc-48980f327a20 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] snapshot_file for this snap is: volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a7f65b-0fb6-4311-954c-373903fb5c7d]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:30 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683
Sep 06 17:19:30 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:30 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683" returned: 0 in 0.353s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60c25d77-b9d1-42b0-bfdc-48980f327a20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced3868-00a5-43bd-9a2d-3638e7c095f4]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:30 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:30 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20
Sep 06 17:19:30 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:31 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20" returned: 0 in 0.345s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:31 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683
Sep 06 17:19:31 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:31 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683" returned: 0 in 0.320s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:31 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683
Sep 06 17:19:31 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:31 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:31 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20.f128b171-6714-4871-88ad-747a8a03a683" returned: 0 in 0.229s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-f128b171-6714-4871-88ad-747a8a03a683" released by "_delete_snapshot" :: held 1.334s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-60c25d77-b9d1-42b0-bfdc-48980f327a20" released by "delete_snapshot" :: held 1.357s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:31 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Created reservations ['0d2121f6-4fd1-49ed-a122-a9f96b73c411', '1f279b85-f5e4-406e-a92c-495d94dee549', 'ad49f064-2b14-4b7f-ba34-ad2116da498e', '5a1ff7e9-d802-4822-b026-db6295cdf8f9'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:31 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Delete snapshot completed successfully.
Sep 06 17:19:31 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-accfaeda-f121-40a4-b833-5ad3f92c12ac tempest-ProjectReaderTests-464573050 None] Lock "cinder-f128b171-6714-4871-88ad-747a8a03a683-delete_snapshot" released by "delete_snapshot" :: held 1.486s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-60c25d77-b9d1-42b0-bfdc-48980f327a20-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Lock "cinder-60c25d77-b9d1-42b0-bfdc-48980f327a20-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-60c25d77-b9d1-42b0-bfdc-48980f327a20" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:32 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-60c25d77-b9d1-42b0-bfdc-48980f327a20" acquired by "delete_volume" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:32 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b71c99a-7e53-4b7f-a940-89b5c30a1645]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:32 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20
Sep 06 17:19:32 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:32 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20" returned: 0 in 0.338s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:32 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:32 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20
Sep 06 17:19:32 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:33 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-60c25d77-b9d1-42b0-bfdc-48980f327a20" returned: 0 in 0.233s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-60c25d77-b9d1-42b0-bfdc-48980f327a20" released by "delete_volume" :: held 0.623s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Created reservations ['06566285-1a1b-45a9-ba5e-4159cc623d7e', 'b737a71a-0b7f-4a4c-a541-92a6ffe6f885', '5c4a87d5-b273-4929-b81b-6efbd5bd869d', '7ff967d5-d2ed-41d3-991a-c33338186d15'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:33 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:19:33 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:33 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.231s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:19:33 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Deleted volume successfully.
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-9d1ee365-10e4-40c2-ba58-e09d5a18e2e7 tempest-ProjectReaderTests-464573050 None] Lock "cinder-60c25d77-b9d1-42b0-bfdc-48980f327a20-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (a537b7f9-2138-40fa-b40e-8e95dbdb3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd529b0-5413-482e-9c93-bd4810c747ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:33 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd529b0-5413-482e-9c93-bd4810c747ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531325327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05500cc-61f6-4cf4-b105-a07e2b2c11f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:34Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d12aadf-e86e-4a5a-897a-d0401c141df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d12aadf-e86e-4a5a-897a-d0401c141df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c8672e-c8e7-4531-b42f-6e7471f69fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c8672e-c8e7-4531-b42f-6e7471f69fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c05500cc-61f6-4cf4-b105-a07e2b2c11f3', 'volume_name': 'volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718bf657-7be3-4746-ab42-cce08a6d5fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (718bf657-7be3-4746-ab42-cce08a6d5fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7146efb3-3722-4adf-99bb-1311806a21fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Volume c05500cc-61f6-4cf4-b105-a07e2b2c11f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3', 'volume_size': 1}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531325327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05500cc-61f6-4cf4-b105-a07e2b2c11f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:34Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Creating volume c05500cc-61f6-4cf4-b105-a07e2b2c11f3 {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:19:34 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:34 devstack sudo[107210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 1073741824
Sep 06 17:19:34 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:34 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 1073741824" returned: 0 in 0.389s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:34 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3
Sep 06 17:19:34 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:34 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" returned: 0 in 0.232s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7146efb3-3722-4adf-99bb-1311806a21fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d3f354-9682-4986-ba96-b171c7d86f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:34 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Volume volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 (c05500cc-61f6-4cf4-b105-a07e2b2c11f3): created successfully
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d3f354-9682-4986-ba96-b171c7d86f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:34 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (a537b7f9-2138-40fa-b40e-8e95dbdb3e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:34 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-38b1769a-e7d3-4160-bcbd-c0be9f341f2d tempest-ProjectReaderTests-464573050 None] Created volume successfully.
Sep 06 17:19:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:35 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Creating offline snapshot aa017659-616b-4ba7-9f86-3e7e1f881009 of volume c05500cc-61f6-4cf4-b105-a07e2b2c11f3 {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:19:35 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be45884-fdc2-401c-99cb-880cdfe00818]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:35 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3
Sep 06 17:19:35 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:35 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" returned: 0 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:35 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 1G
Sep 06 17:19:35 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:35 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 1G" returned: 0 in 0.371s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:35 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:35 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009
Sep 06 17:19:35 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:36 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009" returned: 0 in 0.282s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:36 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 is being set with open permissions: ugo+rw
Sep 06 17:19:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:36 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009
Sep 06 17:19:36 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:36 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009" returned: 0 in 0.242s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:36 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.info
Sep 06 17:19:36 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:36 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.info" returned: 0 in 0.237s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:36 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.info is being set with open permissions: ugo+rw
Sep 06 17:19:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:36 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.info
Sep 06 17:19:36 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:36 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.info" returned: 0 in 0.230s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:36 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.785s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:36 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4419b87b-4b73-486f-9902-9e1c0e674060 tempest-ProjectReaderTests-464573050 None] Create snapshot completed successfully
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-aa017659-616b-4ba7-9f86-3e7e1f881009-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Lock "cinder-aa017659-616b-4ba7-9f86-3e7e1f881009-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-aa017659-616b-4ba7-9f86-3e7e1f881009" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-aa017659-616b-4ba7-9f86-3e7e1f881009" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Deleting offline snapshot aa017659-616b-4ba7-9f86-3e7e1f881009 of volume c05500cc-61f6-4cf4-b105-a07e2b2c11f3 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] snapshot_file for this snap is: volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b49d78d-204c-4c04-a3e2-8bd7dde5b30e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:37 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009
Sep 06 17:19:37 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:37 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009" returned: 0 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[155e39eb-eb0a-482f-8bc9-c750b7993446]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:37 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:37 devstack sudo[107247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3
Sep 06 17:19:37 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:38 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:38 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009
Sep 06 17:19:38 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:38 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009" returned: 0 in 0.313s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:38 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009
Sep 06 17:19:38 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:38 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:38 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3.aa017659-616b-4ba7-9f86-3e7e1f881009" returned: 0 in 0.230s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-aa017659-616b-4ba7-9f86-3e7e1f881009" released by "_delete_snapshot" :: held 1.314s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" released by "delete_snapshot" :: held 1.335s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:38 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Created reservations ['8bbdebde-e52c-4f54-9410-af473a2ab048', '56ddff6c-0498-4ee4-b7de-d6b50c3e792b', '9d40f36f-8885-4f7c-ba21-0dcc4c06db6e', '71c2fb7f-f94a-4014-9cc1-e8cd1f217a18'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:38 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Delete snapshot completed successfully.
Sep 06 17:19:38 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-a370d1ac-2cd1-4e3f-bc05-6ba0f2d09acc tempest-ProjectReaderTests-464573050 None] Lock "cinder-aa017659-616b-4ba7-9f86-3e7e1f881009-delete_snapshot" released by "delete_snapshot" :: held 1.464s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-c05500cc-61f6-4cf4-b105-a07e2b2c11f3-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Lock "cinder-c05500cc-61f6-4cf4-b105-a07e2b2c11f3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:39 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" acquired by "delete_volume" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:39 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50fb28c-7e3e-40d0-a970-6b73add3c471]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:39 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3
Sep 06 17:19:39 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:39 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" returned: 0 in 0.343s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:39 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:39 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3
Sep 06 17:19:39 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:40 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" returned: 0 in 0.239s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-c05500cc-61f6-4cf4-b105-a07e2b2c11f3" released by "delete_volume" :: held 0.633s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Created reservations ['d23f888e-ac1d-4074-a386-a950f55b3af4', '715d0643-18fd-4d72-a8de-8d2f64902a52', '41077664-643b-40aa-afe4-8bc153ad10eb', '9baa461b-7e8e-46a1-b7f1-a2ed1754c91d'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:40 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:19:40 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:40 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.232s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:19:40 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Deleted volume successfully.
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-7823bec4-9a64-4644-8b83-a1069018e5d7 tempest-ProjectReaderTests-464573050 None] Lock "cinder-c05500cc-61f6-4cf4-b105-a07e2b2c11f3-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:40 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (346f7bfa-05da-417a-b9b5-f392ea2cf0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c29bd1-9c7c-4375-989a-86d8a3c4cea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c29bd1-9c7c-4375-989a-86d8a3c4cea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630169001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aac2bd9-2b2d-4f15-9f95-ad07eec953cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:41Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ee5fe1-ebad-4582-9e3d-0614b33e41d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ee5fe1-ebad-4582-9e3d-0614b33e41d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2676266-4d3a-49f8-a272-46784d3de6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2676266-4d3a-49f8-a272-46784d3de6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aac2bd9-2b2d-4f15-9f95-ad07eec953cb', 'volume_name': 'volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a322d7-5b6c-4ef9-be42-5524b32920e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a322d7-5b6c-4ef9-be42-5524b32920e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14186fa-ff7c-465f-b617-adf9ba1b214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:41 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Volume 9aac2bd9-2b2d-4f15-9f95-ad07eec953cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb', 'volume_size': 1}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1630169001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aac2bd9-2b2d-4f15-9f95-ad07eec953cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:41Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Creating volume 9aac2bd9-2b2d-4f15-9f95-ad07eec953cb {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:19:41 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:41 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb 1073741824
Sep 06 17:19:41 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:41 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb 1073741824" returned: 0 in 0.379s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:41 devstack sudo[107278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb
Sep 06 17:19:41 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:41 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" returned: 0 in 0.240s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14186fa-ff7c-465f-b617-adf9ba1b214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3039cc7f-7443-4380-a05c-c5f1fb63fd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:41 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Volume volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb (9aac2bd9-2b2d-4f15-9f95-ad07eec953cb): created successfully
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3039cc7f-7443-4380-a05c-c5f1fb63fd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:41 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (346f7bfa-05da-417a-b9b5-f392ea2cf0f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:41 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-4744ba4e-e256-4703-b430-08db64aea26e tempest-ProjectReaderTests-464573050 None] Created volume successfully.
Sep 06 17:19:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:42 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Creating offline snapshot e64378f2-bb67-4de8-a651-8e3e34d212af of volume 9aac2bd9-2b2d-4f15-9f95-ad07eec953cb {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:19:42 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3cd537-3637-4401-8704-8d68abaf056c]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:42 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb
Sep 06 17:19:42 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:42 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" returned: 0 in 0.341s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:42 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af 1G
Sep 06 17:19:42 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:42 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af 1G" returned: 0 in 0.358s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:42 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:42 devstack sudo[107292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af
Sep 06 17:19:42 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:43 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:43 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af is being set with open permissions: ugo+rw
Sep 06 17:19:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:43 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af
Sep 06 17:19:43 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:43 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af" returned: 0 in 0.236s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:43 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.info
Sep 06 17:19:43 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:43 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.info" returned: 0 in 0.237s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:43 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.info is being set with open permissions: ugo+rw
Sep 06 17:19:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:43 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.info
Sep 06 17:19:43 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:43 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.info" returned: 0 in 0.228s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:43 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.741s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:43 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-11c58024-9fb5-43bb-80fb-2caa34c3a0d1 tempest-ProjectReaderTests-464573050 None] Create snapshot completed successfully
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-e64378f2-bb67-4de8-a651-8e3e34d212af-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Lock "cinder-e64378f2-bb67-4de8-a651-8e3e34d212af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-e64378f2-bb67-4de8-a651-8e3e34d212af" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-e64378f2-bb67-4de8-a651-8e3e34d212af" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Deleting offline snapshot e64378f2-bb67-4de8-a651-8e3e34d212af of volume 9aac2bd9-2b2d-4f15-9f95-ad07eec953cb {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] snapshot_file for this snap is: volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[03475afd-1227-44f3-9b6d-8cac23758822]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:44 devstack sudo[107306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af
Sep 06 17:19:44 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:44 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af" returned: 0 in 0.344s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a41738-880e-41f0-a0cf-343b534b6091]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:44 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:44 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb
Sep 06 17:19:44 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:45 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" returned: 0 in 0.334s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:45 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af
Sep 06 17:19:45 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:45 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af" returned: 0 in 0.339s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:45 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af
Sep 06 17:19:45 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:45 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:45 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb.e64378f2-bb67-4de8-a651-8e3e34d212af" returned: 0 in 0.235s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-e64378f2-bb67-4de8-a651-8e3e34d212af" released by "_delete_snapshot" :: held 1.329s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" released by "delete_snapshot" :: held 1.349s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:45 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Created reservations ['60a92ed2-883e-4e08-897a-ffb73e6fe758', '35071272-b159-4c26-8111-19d5a506af49', '3d613912-e2f6-4e52-944f-556421098a3a', '00cbdb12-4ed6-46ef-9990-d2ad16aeabde'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:45 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Delete snapshot completed successfully.
Sep 06 17:19:45 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-2e8230d0-f0c4-4c6b-ba66-df5ed3e53ef2 tempest-ProjectReaderTests-464573050 None] Lock "cinder-e64378f2-bb67-4de8-a651-8e3e34d212af-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Lock "cinder-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:46 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" acquired by "delete_volume" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:46 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a4b0fb-efbc-446f-93d5-5491bd72551e]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:46 devstack sudo[107324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb
Sep 06 17:19:46 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:46 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" returned: 0 in 0.339s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:46 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:46 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb
Sep 06 17:19:46 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:47 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" returned: 0 in 0.231s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb" released by "delete_volume" :: held 0.621s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Created reservations ['fa044051-9604-44c2-9eed-0dbfec4d31d6', '8de77d51-7708-4edf-b5f4-89452d2cb6a7', '9c468796-8d77-4612-93dc-c395e231e697', '33b60c28-1d53-45a0-8c9d-138ab1d03515'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:47 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:19:47 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:47 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.230s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:19:47 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Deleted volume successfully.
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-381c5fe9-2127-4d30-aff4-eebfcef5070f tempest-ProjectReaderTests-464573050 None] Lock "cinder-9aac2bd9-2b2d-4f15-9f95-ad07eec953cb-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.flows.manager.create_volume [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87474) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (7bd4eb0e-5c6a-4cd8-a3b2-07bb5948e13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdfa753-0961-460b-ae13-d29f1d30e179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfdfa753-0961-460b-ae13-d29f1d30e179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1181882404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab11e967-5feb-4257-8e8b-10a89c819acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:48Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c13dab8-74bd-47f6-8b38-0ff087b10ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c13dab8-74bd-47f6-8b38-0ff087b10ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad682ed-f934-4321-87c4-df47390b00f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:47 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad682ed-f934-4321-87c4-df47390b00f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab11e967-5feb-4257-8e8b-10a89c819acd', 'volume_name': 'volume-ab11e967-5feb-4257-8e8b-10a89c819acd', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9e673d-027f-41df-8bc8-9082b4435370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9e673d-027f-41df-8bc8-9082b4435370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c2e5c9-5e92-4dca-bc9f-b7bf8c8c7d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:48 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Volume ab11e967-5feb-4257-8e8b-10a89c819acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab11e967-5feb-4257-8e8b-10a89c819acd', 'volume_size': 1}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x77a009d10140>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-06T15:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1181882404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab11e967-5feb-4257-8e8b-10a89c819acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f870b805cc74779944ef2ae13cf2fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T15:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T15:19:48Z,use_quota=True,user_id='2a0074e20df648f1a41057d8c822c047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6cd76f2-2e23-4511-b89f-dd0395fb7be1),volume_type_id=d6cd76f2-2e23-4511-b89f-dd0395fb7be1)}" {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Creating volume ab11e967-5feb-4257-8e8b-10a89c819acd {{(pid=87474) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Selected osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051 as target Quobyte volume. {{(pid=87474) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 06 17:19:48 devstack cinder-volume[87474]: INFO cinder.volume.drivers.remotefs [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] casted to osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd 1073741824 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:48 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd 1073741824
Sep 06 17:19:48 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:48 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd 1073741824" returned: 0 in 0.378s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:48 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd
Sep 06 17:19:48 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:48 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd" returned: 0 in 0.230s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] <== create_volume: return (646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'} {{(pid=87474) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.648s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c2e5c9-5e92-4dca-bc9f-b7bf8c8c7d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab11e967-5feb-4257-8e8b-10a89c819acd', 'volume_size': 1}' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c487e3e-10f1-4bf9-88dc-33e863929f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 06 17:19:48 devstack cinder-volume[87474]: INFO cinder.volume.flows.manager.create_volume [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Volume volume-ab11e967-5feb-4257-8e8b-10a89c819acd (ab11e967-5feb-4257-8e8b-10a89c819acd): created successfully
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c487e3e-10f1-4bf9-88dc-33e863929f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87474) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 06 17:19:48 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Flow 'volume_create_manager' (7bd4eb0e-5c6a-4cd8-a3b2-07bb5948e13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87474) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 06 17:19:48 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-3317588f-262c-47d1-9dbf-a404be76238b tempest-ProjectReaderTests-464573050 None] Created volume successfully.
Sep 06 17:19:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:49 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Creating offline snapshot 3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 of volume ab11e967-5feb-4257-8e8b-10a89c819acd {{(pid=87474) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 06 17:19:49 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f1fb38-a0b8-4619-9a6b-6e59e25f4bc5]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:49 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd
Sep 06 17:19:49 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:49 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd" returned: 0 in 0.338s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 1G {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:49 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 1G
Sep 06 17:19:49 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:49 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 1G" returned: 0 in 0.366s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:49 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab11e967-5feb-4257-8e8b-10a89c819acd -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:49 devstack sudo[107354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab11e967-5feb-4257-8e8b-10a89c819acd -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411
Sep 06 17:19:49 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:50 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab11e967-5feb-4257-8e8b-10a89c819acd -F qcow2 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411" returned: 0 in 0.271s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:50 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 is being set with open permissions: ugo+rw
Sep 06 17:19:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:50 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411
Sep 06 17:19:50 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:50 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411" returned: 0 in 0.244s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:50 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.info
Sep 06 17:19:50 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:50 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.info" returned: 0 in 0.240s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:50 devstack cinder-volume[87474]: WARNING cinder.volume.drivers.remotefs [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.info is being set with open permissions: ugo+rw
Sep 06 17:19:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.info {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:50 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.info
Sep 06 17:19:50 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:50 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.info" returned: 0 in 0.233s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:50 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.764s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:50 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-692ffa2d-f0e3-4a93-969c-f88e6ebeeb02 tempest-ProjectReaderTests-464573050 None] Create snapshot completed successfully
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-3f1b44af-e3d2-4e51-bbf1-7320bb2b5411-delete_snapshot" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Lock "cinder-3f1b44af-e3d2-4e51-bbf1-7320bb2b5411-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-ab11e967-5feb-4257-8e8b-10a89c819acd" by "delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-ab11e967-5feb-4257-8e8b-10a89c819acd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-3f1b44af-e3d2-4e51-bbf1-7320bb2b5411" by "_delete_snapshot" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-3f1b44af-e3d2-4e51-bbf1-7320bb2b5411" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Deleting offline snapshot 3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 of volume ab11e967-5feb-4257-8e8b-10a89c819acd {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] snapshot_file for this snap is: volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 {{(pid=87474) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a97a6fa-821a-4b01-b8ce-32ff8d9870fe]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:51 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411
Sep 06 17:19:51 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:51 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411" returned: 0 in 0.347s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.remotefs [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab11e967-5feb-4257-8e8b-10a89c819acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87474) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc35b8c3-a7e6-4c53-84e6-fe476a8c3723]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:51 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:51 devstack sudo[107373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd
Sep 06 17:19:51 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:52 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd" returned: 0 in 0.334s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:52 devstack sudo[107379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411
Sep 06 17:19:52 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:52 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411" returned: 0 in 0.317s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:52 devstack sudo[107384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411
Sep 06 17:19:52 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:52 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:52 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd.3f1b44af-e3d2-4e51-bbf1-7320bb2b5411" returned: 0 in 0.237s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-3f1b44af-e3d2-4e51-bbf1-7320bb2b5411" released by "_delete_snapshot" :: held 1.318s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-ab11e967-5feb-4257-8e8b-10a89c819acd" released by "delete_snapshot" :: held 1.340s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:52 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Created reservations ['7e8494d0-5be7-4138-b621-52aa664e9047', 'b3f879ab-41d8-4d2a-8b79-94074c3f653b', 'eccbdd4d-f4e0-48f1-aebf-c7e627df43a9', '5d32d653-2ad6-4bdf-99bf-d5d3b11d3f87'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:52 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Delete snapshot completed successfully.
Sep 06 17:19:52 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-8b52cc2f-c724-4077-8776-5a492e79fe96 tempest-ProjectReaderTests-464573050 None] Lock "cinder-3f1b44af-e3d2-4e51-bbf1-7320bb2b5411-delete_snapshot" released by "delete_snapshot" :: held 1.471s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-ab11e967-5feb-4257-8e8b-10a89c819acd-delete_volume" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Lock "cinder-ab11e967-5feb-4257-8e8b-10a89c819acd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:53 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=109,cinder:INSERT=44,cinder:UPDATE=149,cinder:DELETE=14 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:19:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Acquiring lock "cinder-quobyte-ab11e967-5feb-4257-8e8b-10a89c819acd" by "delete_volume" {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 06 17:19:53 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-ab11e967-5feb-4257-8e8b-10a89c819acd" acquired by "delete_volume" :: waited 0.017s {{(pid=87474) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 06 17:19:53 devstack cinder-volume[87474]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a4ced4-0c51-4f23-8616-0fd7e0f40f42]: (4, 'qcow2') {{(pid=88790) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 06 17:19:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:53 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd
Sep 06 17:19:53 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:53 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd" returned: 0 in 0.339s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:53 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:53 devstack sudo[107392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd
Sep 06 17:19:53 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:54 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2/volume-ab11e967-5feb-4257-8e8b-10a89c819acd" returned: 0 in 0.232s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Lock "cinder-quobyte-ab11e967-5feb-4257-8e8b-10a89c819acd" released by "delete_volume" :: held 0.620s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG cinder.quota [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Created reservations ['bd7de94d-e461-4be8-8aac-502667fa95cd', '68dab9bf-6176-473b-a186-eddbaf055e0d', '54447a65-9f8c-4224-b7e2-df1ba3937fb2', '1361e282-9ee9-41df-a31f-3bb9d1f4d813'] {{(pid=87474) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:19:54 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:19:54 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:19:54 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.231s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:19:54 devstack cinder-volume[87474]: INFO cinder.volume.manager [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Deleted volume successfully.
Sep 06 17:19:54 devstack cinder-volume[87474]: DEBUG cinder.coordination [None req-e3afb828-37d5-4c0d-8a44-9ab5992e9d92 tempest-ProjectReaderTests-464573050 None] Lock "cinder-ab11e967-5feb-4257-8e8b-10a89c819acd-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87474) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 06 17:20:04 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=99,cinder:DELETE=9,cinder:INSERT=35,cinder:UPDATE=127 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:20:04 devstack cinder-volume[87474]: DEBUG dbcounter [-] [87474] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87474) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051': None} {{(pid=87474) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG cinder.volume.drivers.quobyte [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3ac5f2b1-f40f-4c32-aa55-ec3731084051'] {{(pid=87474) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.lockutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87474) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2 {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 06 17:20:26 devstack sudo[107700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2
Sep 06 17:20:26 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 06 17:20:26 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG oslo_concurrency.processutils [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b3583237b9a7b29605680d79d05b2e2" returned: 0 in 0.237s {{(pid=87474) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG cinder.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Notifying Schedulers of capabilities ... {{(pid=87474) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG oslo_service.periodic_task [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] Running periodic task VolumeManager._thread_info {{(pid=87474) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread count: 29 {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 06 17:20:26 devstack cinder-volume[87474]: DEBUG cinder.volume.manager [None req-3a2e200a-3633-46a8-9c74-31e53932b76b None None] thread info: [<_MainThread(MainThread, started 131529349316736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 131529237448832)>, <Thread(Thread-3 (stat_writer), started daemon 131529234531328)>, <Thread(Rabbit-heartbeat, started daemon 131529234911936)>, <Thread(Thread-5 (_runner), started daemon 131529233277440)>, <Thread(Thread-7 (_runner), started daemon 131529233373184)>, <Thread(fd_logger, started daemon 131529230341120)>, <Thread(privsep_reader, started daemon 131529231330944)>, <Thread(Rabbit-heartbeat, started daemon 131529232331584)>, <Thread(tpool_thread_0, started daemon 131529223505600)>, <Thread(tpool_thread_1, started daemon 131529215096512)>, <Thread(tpool_thread_2, started daemon 131529206687424)>, <Thread(tpool_thread_3, started daemon 131529198278336)>, <Thread(tpool_thread_4, started daemon 131529189869248)>, <Thread(tpool_thread_5, started daemon 131529181460160)>, <Thread(tpool_thread_6, started daemon 131529173051072)>, <Thread(tpool_thread_7, started daemon 131529164641984)>, <Thread(tpool_thread_8, started daemon 131529156232896)>, <Thread(tpool_thread_9, started daemon 131529147823808)>, <Thread(tpool_thread_10, started daemon 131529139414720)>, <Thread(tpool_thread_11, started daemon 131529131005632)>, <Thread(tpool_thread_12, started daemon 131529122596544)>, <Thread(tpool_thread_13, started daemon 131529114187456)>, <Thread(tpool_thread_14, started daemon 131529105778368)>, <Thread(tpool_thread_15, started daemon 131529097369280)>, <Thread(tpool_thread_16, started daemon 131529088960192)>, <Thread(tpool_thread_17, started daemon 131529080551104)>, <Thread(tpool_thread_18, started daemon 131529072142016)>, <Thread(tpool_thread_19, started daemon 131529063732928)>] {{(pid=87474) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}